Method and apparatus for multiple mode interface

ABSTRACT

A method, system, apparatus, and/or device for executing a translation instruction for a constructive movement. The method, system, apparatus, and/or device may include an input device configured to sense a first constructive movement input representative of a non-translational movement of a body of a user that does not move from a first point to a second point in the physical world environment. The method, system, apparatus, and/or device may include a processing device coupled to the input device, where the processing device is configured to execute a translational instruction associated with the first constructive movement input, execute a first resizing instruction to reduce a size of a portion of the physical world environment as displayed by a head-mounted display by an amount indicated by the first resizing stimulus, receive a second constructive movement input, and execute a second translational instruction associated with the second constructive translational movement input.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No.16/169,916, filed Oct. 24, 2018, which is a continuation of U.S. patentapplication Ser. No. 14/505,295, filed Oct. 2, 2014, which claims thebenefit of U.S. provisional patent application No. 61/885,896 filed onOct. 2, 2013, the contents of which are incorporated by reference forall intents and purposes.

BACKGROUND

A user interface may serve as a space or environment wherein a userinteracts with some system, for example receiving data from that systemand/or sending instructions to the system. The term is frequentlyapplied to the use of computers and other information systems.

To date many user interfaces, including but not limited to graphicalinterfaces, have been designed to support a single mode of interaction.For certain environments, such an arrangement may be suitable. However,as environments become increasingly rich in terms of the amount andcomplexity of content therein, the number and sophistication ofavailable system functions, the environment dimensionality (for example2D or 3D), etc., single-mode interfaces may prove insufficientlyflexible to support a desired level of user interaction.

There is a need for a simple, efficient method and apparatus forinterfacing between a user and a system, potentially supporting multiplemodes of interaction.

SUMMARY

The present embodiment contemplates a variety of systems, apparatus,methods, and paradigms for interacting with the system using multiplemodes.

In one embodiment of the present embodiment, a machine-implementedmethod is provided that includes establishing a world space, the worldspace being adapted to accept at least one entity therein, the worldentity comprising at least one of a group consisting of a virtualreality entity and an augmented reality entity, wherein translation by aviewer substantially corresponds with translation with respect to theworld space, and wherein rotation by the viewer substantiallycorresponds with rotation with respect to the world space. The methodalso includes establishing a sphere space, the sphere space beingadapted to accept at least one entity therein, wherein translation bythe viewer corresponds with substantially zero translation with respectto the sphere space, and wherein rotation by the viewer substantiallycorresponds with rotation with respect to the sphere space. The methodfurther includes establishing a display space, the display space beingadapted to accept at least one entity therein, wherein translation bythe viewer corresponds with substantially zero translation with respectto the display space, and wherein rotation by the viewer correspondswith substantially zero rotation with respect to the display space.

The method may include establishing a world space rotation stimulus, andestablishing a world space rotation response with the world spacerotation response including a rotation of the world space relative tothe viewer not corresponding with the rotation by the viewer, sensingthe presence of the world space rotation stimulus, and executing theworld space rotation response if the world space rotation stimulus ispresent. The world space rotation stimulus may include a user input. Theworld space rotation stimulus may include a hand posture, a handgesture, a stylus posture, a stylus gesture, an eye gesture, and/or abrainwave modulation.

The method may include establishing a world space translation stimulus,and establishing a world space translation response with the world spacetranslation response including a translation of the world space relativeto the viewer not corresponding with the translation by the viewer,sensing the presence of the world space translation stimulus, andexecuting the world space translation response if the world spacetranslation stimulus is present. The world space translation stimulusmay include a user input. The world space translation stimulus mayinclude a hand posture, a hand gesture, a stylus posture, a stylusgesture, an eye gesture, and/or a brainwave modulation.

The method may include establishing a world space resizing stimulus, andestablishing a world space resizing response with the world spaceresizing response including a change in size of the world space relativeto the viewer, sensing a presence of the world space resizing stimulus,and executing the world space resizing response if the world spaceresizing stimulus is present. The world space resizing stimulus mayinclude a user input. The world space resizing stimulus may include ahand posture, a hand gesture, a stylus posture, a stylus gesture, an eyegesture, and/or a brainwave modulation.

The method may include establishing a sphere space rotation stimulus,and establishing a sphere space rotation response, the sphere spacerotation response including a rotation of the sphere space relative tothe viewer not corresponding with the rotation by the viewer, sensing apresence of the sphere stimulus, and executing the sphere response ifthe sphere stimulus is present. The sphere space rotation stimulus mayinclude a user input. The sphere space rotation stimulus may include ahand posture, a hand gesture, a stylus posture, a stylus gesture, an eyegesture, and/or a brainwave modulation.

The method may include establishing a sphere space translation stimulus,and establishing a sphere space translation response with the spherespace rotation response comprising a translation of the sphere spacerelative to the viewer not corresponding with the translation by theviewer, sensing a presence of the sphere space translation stimulus, andexecuting the sphere space translation response if the sphere spacetranslation stimulus is present. The sphere space translation stimulusmay include a user input. The sphere space translation stimulus mayinclude a hand posture, a hand gesture, a stylus posture, a stylusgesture, an eye gesture, and/or a brainwave modulation.

The method may include establishing a sphere space resizing stimulus,and establishing a sphere space resizing response with the sphere spaceresizing response including a change in size of the sphere spacerelative to the viewer, sensing a presence of the sphere space resizingstimulus, and executing the sphere space resizing response if the spherespace resizing stimulus is present. The sphere space resizing stimulusmay include a user input. The sphere space resizing stimulus may includea hand posture, a hand gesture, a stylus posture, a stylus gesture, aneye gesture, and/or a brainwave modulation.

The method may include establishing a display space rotation stimulus,and establishing a display space rotation response with the displayspace rotation response including a rotation of the display spacerelative to the viewer not corresponding with the rotation by theviewer, sensing a presence of the display space rotation stimulus, andexecuting the display space rotation response if the display spacerotation stimulus is present. The display space rotation stimulus mayinclude a user input. The display space rotation stimulus may include ahand posture, a hand gesture, a stylus posture, a stylus gesture, an eyegesture, and/or a brainwave modulation.

The method may include establishing a display space translationstimulus, and establishing a display space translation response with thedisplay space translation response including a translation of thedisplay space relative to the viewer not corresponding with thetranslation by the viewer, sensing a presence of the display spacetranslation stimulus, and executing the display space translationresponse if the display space translation stimulus is present. Thedisplay space translation stimulus may include a user input. The displayspace translation stimulus may include a hand posture, a hand gesture, astylus posture, a stylus gesture, an eye gesture, and/or a brainwavemodulation.

The method may include establishing a display space resizing stimulus,and establishing a display space resizing response with the displayspace resizing response including a change in size of the display spacerelative to the viewer, sensing a presence of the display space resizingstimulus, and executing the display space resizing response if thedisplay space resizing stimulus is present. The display space resizingstimulus may include a user input. The display space resizing stimulusmay include a hand posture, a hand gesture, a stylus posture, a stylusgesture, an eye gesture, and/or a brainwave modulation.

The translation by the user may include constructive translation. Therotation by the user may include constructive rotation.

The method may include establishing an entity resizing stimulus andestablishing an entity resizing response with the entity resizingresponse including a change of size of at least one of the at least oneentities, sensing a presence of the entity resizing stimulus, andexecuting the entity resizing response if the entity resizing stimulusis present. The entity resizing stimulus may include a user input. Theentity resizing stimulus may include a voice command, a hand posture, ahand gesture, a stylus posture, a stylus gesture, an eye gesture, and/ora brainwave modulation.

In another embodiment of the present embodiment, an apparatus isprovided that includes a processor, at least one sensor in communicationwith the processor, the sensor being adapted to sense a translation of aviewer and a rotation of the viewer, and an outputter in communicationwith the processor. The processor is adapted to establish a world space,the world space being adapted to at least one virtual reality entity oraugmented reality entity therein. The processor is adapted to establisha sphere space, the sphere space being adapted to accept at least onevirtual reality entity or augmented reality entity therein. Theprocessor is adapted to establish a display space, the display spacebeing adapted to accept at least one virtual reality entity or augmentedreality entity therein.

For the translation of the viewer as sensed by the sensor, the processoris adapted to determine a substantially corresponding translation of theviewer with respect to the world space. For the rotation of the vieweras sensed by the sensor, the processor is adapted to determine asubstantially corresponding rotation of the viewer with respect to theworld space. For the translation of the viewer as sensed by the sensor,the processor is adapted to determine a substantially correspondingtranslation of the viewer with respect to the sphere space. For therotation of the viewer as sensed by the sensor, the processor is adaptedto determine a substantially zero rotation of the viewer with respect tothe sphere space. For the translation of the viewer as sensed by thesensor, the processor is adapted to determine a substantially zerotranslation of the viewer with respect to the display space. For therotation of the viewer as sensed by the sensor, the processor is adaptedto determine a substantially zero rotation of the viewer with respect tothe display space.

The outputter is adapted to output the substantially correspondingtranslation of the viewer with respect to the world space. The outputteris adapted to output the substantially corresponding rotation of theviewer with respect to the world space. The outputter is adapted tooutput the substantially corresponding translation of the viewer withrespect to the sphere space. The outputter is adapted to output thesubstantially zero rotation of the viewer with respect to the spherespace. The outputter is adapted to output the substantially zerotranslation of the viewer with respect to the display space. Theoutputter is adapted to output the substantially zero rotation of theviewer with respect to the display space.

The sensor may include an imager. The sensor may include a stereo pairof imagers. The sensor may be an accelerometer, a gyroscope, a GPSsensor, a magnetometer, a structured light sensor, a time-of-flightsensor, an ultrasonic sensor, and/or a wireless signal triangulationsensor.

The outputter may include a visual display. The outputter may include astereo visual display.

At least a portion of the apparatus may be disposed on a head-mounteddisplay.

In another embodiment of the present embodiment, an apparatus isprovided that includes means for establishing a world space, the worldspace being adapted to accept virtual reality entities and/or augmentedreality entities therein, wherein translation by a viewer substantiallycorresponds with translation with respect to the world space, andwherein rotation by the viewer substantially corresponds with rotationwith respect to the world space. The apparatus also includes means forestablishing a sphere space, the sphere space being adapted to acceptvirtual reality entities and/or augmented reality entities therein,wherein translation by the viewer corresponds with substantially zerotranslation with respect to the sphere space, and wherein rotation bythe viewer substantially corresponds with rotation with respect to thesphere space. The apparatus further includes means for establishing adisplay space, the display space being adapted to accept virtual realityentities and/or augmented reality entities therein, wherein translationby the viewer corresponds with substantially zero translation withrespect to the display space, and wherein rotation by the viewercorresponds with substantially zero rotation with respect to the displayspace.

In another embodiment of the present embodiment, a machine-implementedmethod is provided that includes determining a translation of a viewerand determining a rotation of the viewer. For a world space adapted toaccept at least one entity therein, the entity including at least one ofa group consisting of a virtual reality entity and an augmented realityentity, if the translation of the viewer is determined to be present, inresponse thereto a world space translation change is applied to theworld space substantially corresponding with the translation of theviewer. For a sphere space adapted to accept at least one entitytherein, if the translation of the viewer is determined to be present,in response thereto substantially zero translation change is applied tothe sphere space. For a display space adapted to accept at least one theentity therein, if the translation of the viewer is determined to bepresent, in response thereto substantially zero translation change isapplied to the display space. Again for the world space, if the rotationof the viewer is determined to be present, in response thereto a worldspace rotation change is applied to the world space substantiallycorresponding with the rotation of the viewer. Again for the spherespace, if the rotation of the viewer is determined to be present, inresponse thereto a sphere space rotation change is applied to the spherespace substantially corresponding with the rotation of the viewer. Againfor the display space, if the rotation of the viewer is determined to bepresent, in response thereto substantially zero rotation change isapplied to the display space.

The method may include determining a presence of a world space rotationstimulus, and if the world space rotation stimulus is presentlyexecuting a world space rotation response, the world space rotationresponse including a rotation of the world space relative to the viewernot corresponding with the rotation by the viewer. The world spacerotation stimulus may include a user input. The world space rotationstimulus may include a voice command, a hand posture, a hand gesture, astylus posture, a stylus gesture, an eye gesture, and/or a brainwavemodulation.

The method may include determining a presence of a world spacetranslation stimulus, and if the world space translation stimulus ispresently executing a world space translation response, the world spacetranslation response including a translation of the world space relativeto the viewer not corresponding with the translation by the viewer. Theworld space translation stimulus includes a user input. The world spacetranslation stimulus may include a voice command, a hand posture, a handgesture, a stylus posture, a stylus gesture, an eye gesture, and/or abrainwave modulation.

The method may include determining a presence of a world space resizingstimulus, and if the world space resizing stimulus is present executinga world space resizing response, the world space resizing responseincluding a change in the size of the world space relative to theviewer. The world space resizing stimulus may include a user input. Theworld space resizing stimulus may include a voice command, a handposture, a hand gesture, a stylus posture, a stylus gesture, an eyegesture, and/or a brainwave modulation.

The method may include determining a presence of a sphere space rotationstimulus, and if the sphere space rotation stimulus is presentlyexecuting a sphere space rotation response, the sphere space rotationresponse including a rotation of the sphere space relative to the viewernot corresponding with the rotation by the viewer. The sphere spacerotation stimulus may include a user input. The sphere space rotationstimulus may include a voice command, a hand posture, a hand gesture, astylus posture, a stylus gesture, an eye gesture, and/or a brainwavemodulation.

The method may include determining a presence of a sphere spacetranslation stimulus, and if the sphere space translation stimulus ispresently executing a sphere space translation response, the spherespace translation response including a translation of the sphere spacerelative to the viewer not corresponding with the translation by theviewer. The sphere space translation stimulus may include a user input.The sphere space translation stimulus may include a voice command, ahand posture, a hand gesture, a stylus posture, a stylus gesture, an eyegesture, and/or a brainwave modulation.

The method may include determining a presence of a sphere space resizingstimulus, and if the sphere space resizing stimulus is present executinga sphere space resizing response, the sphere space resizing responseincluding a change in the size of the sphere space relative to theviewer. The sphere space resizing stimulus may include a user input. Thesphere space resizing stimulus may include a voice command, a handposture, a hand gesture, a stylus posture, a stylus gesture, an eyegesture, and/or a brainwave modulation.

The method may include determining a display space rotation stimulus,and if the display space rotation stimulus is presently executing adisplay space rotation response, the display space rotation responseincluding a rotation of the display space relative to the viewer notcorresponding with the rotation by the viewer. The display spacerotation stimulus may include a user input. The display space rotationstimulus may include a voice command, a hand posture, a hand gesture, astylus posture, a stylus gesture, an eye gesture, and/or a brainwavemodulation.

The method may include determining a presence of a display spacetranslation stimulus, and if the display space translation stimulus ispresently executing a display space translation response, the displayspace translation response including a translation of the display spacerelative to the viewer not corresponding with the translation by theviewer. The display space translation stimulus may include a user input.The display space translation stimulus may include a voice command, ahand posture, a hand gesture, a stylus posture, a stylus gesture, an eyegesture, and/or a brainwave modulation.

The method may include determining a presence of a display spaceresizing stimulus, and if the display space resizing stimulus is presentexecuting a display space resizing response, the display space resizingresponse including a change in the size of the display space relative tothe viewer. The display space resizing stimulus may include a userinput. The display space resizing stimulus may include a voice command,a hand posture, a hand gesture, a stylus posture, a stylus gesture, aneye gesture, and/or a brainwave modulation.

The translation by the user may include constructive translation. Therotation by the user may include constructive rotation. The method mayinclude determining a presence of an entity resizing stimulus, and ifthe entity resizing stimulus is presently executing an entity resizingresponse, the entity resizing response including a change of size of atleast one of the at least one entities. The entity resizing stimulus mayinclude a user input. The entity resizing stimulus may include a voicecommand, a hand posture, a hand gesture, a stylus posture, a stylusgesture, an eye gesture, and/or a brainwave modulation.

In another embodiment of the present embodiment, a processing interfaceis provided that includes a world space, the world space being adaptedto accept at least one entity therein, the entity being virtual realityentity and/or an augmented reality entity, the world space being adaptedto exhibit a world space translation change in response to a translationby a viewer, the world space translation change substantiallycorresponding with translation with respect to the world space. Theworld space is also adapted to exhibit a world space rotation change inresponse to a rotation by a viewer, the world space rotation changesubstantially corresponding with rotation with respect to the worldspace. The interface includes a sphere space, the sphere space beingadapted to accept at least one entity therein, the sphere space beingadapted to exhibit substantially zero change in response to thetranslation by the viewer. The sphere space is also adapted to exhibit asphere space rotation change in response to the rotation by the viewer,the sphere space rotation change substantially corresponding withrotation with respect to the sphere space. The interface also includes adisplay space, the display space being adapted to accept at least oneentity therein, the display space being adapted to exhibit substantiallyzero change in response to the translation by the viewer. The displayspace is also adapted to exhibit substantially zero change in responseto the rotation by the viewer.

The world space may be adapted to exhibit a world space rotationresponse in response to a world space rotation stimulus, with the worldspace rotation response including a rotation of the world space relativeto the viewer not corresponding with the rotation by the viewer. Theworld space rotation stimulus may include a user input. The world spacerotation stimulus may include a voice command, a hand posture, a handgesture, a stylus posture, a stylus gesture, an eye gesture, and/or abrainwave modulation.

The world space interface may be adapted to exhibit a world spacetranslation response in response to a world space translation stimulus,with the world space translation response including a translation of theworld space relative to the viewer not corresponding with thetranslation by the viewer. The world space translation stimulus mayinclude a user input. The world space translation stimulus may include avoice command, a hand posture, a hand gesture, a stylus posture, astylus gesture, an eye gesture, and/or a brainwave modulation.

The world space interface may be adapted to exhibit a world spaceresizing response in response to a world space resizing stimulus, withthe world space resizing response including a change in the size of theworld space relative to the viewer. The world space resizing stimulusmay include a user input. The world space resizing stimulus may includea voice command, a hand posture, a hand gesture, a stylus posture, astylus gesture, an eye gesture, and/or a brainwave modulation.

The sphere space interface may be adapted to exhibit a sphere spacerotation response in response to a sphere space rotation stimulus, withthe sphere space rotation response including a rotation of the spherespace relative to the viewer not corresponding with the rotation by theviewer. The sphere space rotation stimulus may include a user input. Thesphere space rotation stimulus may include a voice command, a handposture, a hand gesture, a stylus posture, a stylus gesture, an eyegesture, and/or a brainwave modulation.

The sphere space interface may be adapted to exhibit a sphere spacetranslation response in response to a sphere space translation stimulus,with the sphere space translation response including a translation ofthe sphere space relative to the viewer not corresponding with thetranslation by the viewer. The sphere space translation stimulus mayinclude a user input. The sphere space translation stimulus may includea voice command, a hand posture, a hand gesture, a stylus posture, astylus gesture, an eye gesture, and/or a brainwave modulation.

The sphere space may be adapted to exhibit a sphere space resizingresponse in response to a sphere space resizing stimulus, with thesphere space resizing response including a change in the size of thesphere space relative to the viewer. The sphere space resizing stimulusmay include a user input. The sphere space resizing stimulus may includea voice command, a hand posture, a hand gesture, a stylus posture, astylus gesture, an eye gesture, and/or a brainwave modulation.

The display space may be adapted to exhibit a display space rotationresponse in response to a display space rotation stimulus, with thedisplay space rotation response including a rotation of the displayspace relative to the viewer not corresponding with the rotation by theviewer. The display space rotation stimulus may include a user input.The display space rotation stimulus may include a voice command, a handposture, a hand gesture, a stylus posture, a stylus gesture, an eyegesture, and/or a brainwave modulation.

The display space may be adapted to exhibit a display space translationresponse in response to a display space translation stimulus, with thedisplay space translation response including a translation of thedisplay space relative to the viewer not corresponding with thetranslation by the viewer. The display space translation stimulus mayinclude a user input. The display space translation stimulus may includea voice command, a hand posture, a hand gesture, a stylus posture, astylus gesture, an eye gesture, and/or a brainwave modulation.

The display space may be adapted to exhibit a display space resizingresponse in response to a display space resizing stimulus, with thedisplay space resizing response including a change in the size of thedisplay space relative to the viewer. The display space resizingstimulus may include a user input. The display space resizing stimulusmay include a voice command, a hand posture, a hand gesture, a stylusposture, a stylus gesture, an eye gesture, and/or a brainwavemodulation.

The translation by the user may include constructive translation. Therotation by the user may include constructive rotation.

At least one of the world space, the sphere space, and the display spacemay be adapted to exhibit an entity resizing response in response to anentity resizing stimulus, the entity resizing stimulus including achange in the size of at least one of the at least one entities. Theentity resizing stimulus may include a user input. The entity resizingstimulus may include a voice command, a hand posture, a hand gesture, astylus posture, a stylus gesture, an eye gesture, and/or a brainwavemodulation.

At least one of the at least one entities may be adapted to exhibit anentity resizing response in response to an entity resizing stimulus, theentity resizing stimulus including a change in the size of the at leastone of the at least one entities. The entity resizing stimulus mayinclude a user input. The entity resizing stimulus may include a voicecommand, a hand posture, a hand gesture, a stylus posture, a stylusgesture, an eye gesture, and/or a brainwave modulation.

In another embodiment of the present embodiment, a method is providedthat includes instantiating on a processor a translation determiner, thetranslation determiner including executable instructions adapted fordetermining a translation of a viewer, and instantiating on theprocessor a rotation determiner, the rotation determiner includingexecutable instructions adapted for determining a rotation of a viewer.The method includes instantiating on the processor a world space, theworld space including executable instructions adapted to accept at leastone entity disposed therein, the entity including a virtual realityentity and/or an augmented reality entity. The world space includesexecutable instructions adapted to manifest a world space translationchange in response to a translation by a viewer, the world spacetranslation change substantially corresponding with translation withrespect to the world space. The world space includes executableinstructions adapted to manifest a world space rotation change inresponse to a rotation by a viewer, the world space rotation changesubstantially corresponding with rotation with respect to the worldspace. The method includes instantiating on the processor a spherespace, the sphere space including executable instructions adapted toaccept at least one entity disposed therein. The sphere space includesexecutable instructions adapted to manifest substantially zero change inresponse to the translation by the viewer. The sphere space includesexecutable instructions adapted to manifest a sphere space rotationchange in response to the rotation by the viewer, the sphere spacerotation change substantially corresponding with rotation with respectto the sphere space. The method includes instantiating on the processora display space, the display space including executable instructionsadapted to accept at least one entity disposed therein. The displayspace includes executable instructions adapted to manifest substantiallyzero change in response to the translation by the viewer. The displayspace includes executable instructions adapted to manifest substantiallyzero change in response to the rotation by the viewer.

The method may include instantiating on the processor an exceptiondeterminer, the exception determiner including executable instructionsadapted to determine a presence of a world space rotation stimulus,world space translation stimulus, world space resizing stimulus, spherespace rotation stimulus, sphere space translation stimulus, sphere spaceresizing stimulus, display space rotation stimulus, display spacetranslation stimulus, and/or display space resizing stimulus. The methodalso may include instantiating on the processor an exception controller,the exception controller being adapted to manifest a world spacerotation response, world space translation response, world spaceresizing response, sphere space rotation response, sphere spacetranslation response, sphere space resizing response, display spacerotation response, display space translation response, and/or displayspace resizing response, respectively in response to the world spacerotation stimulus, world space translation stimulus, world spaceresizing stimulus, sphere space rotation stimulus, sphere spacetranslation stimulus, sphere space resizing stimulus, display spacerotation stimulus, display space translation stimulus, and/or displayspace resizing stimulus. The world space rotation response includes arotation of the world space relative to the viewer not correspondingwith the rotation by the viewer, the world space rotation responseincludes a translation of the world space relative to the viewer notcorresponding with the translation by the viewer, and the world spaceresizing response includes a change in size of the world space relativeto the viewer. The sphere space rotation response includes a rotation ofthe sphere space relative to the viewer not corresponding with therotation by the viewer, the sphere space rotation response includes atranslation of the sphere space relative to the viewer not correspondingwith the translation by the viewer, and the sphere space resizingresponse includes a change in size of the sphere space relative to theviewer. The display space rotation response includes a rotation of thedisplay space relative to the viewer not corresponding with the rotationby the viewer, the display space rotation response includes atranslation of the display space relative to the viewer notcorresponding with the translation by the viewer, and the display spaceresizing response includes a change in size of the display spacerelative to the viewer.

The world space rotation stimulus may include a user input. The worldspace rotation stimulus may include a voice command, a hand posture, ahand gesture, a stylus posture, a stylus gesture, an eye gesture, and/ora brainwave modulation. The world space translation stimulus may includea user input. The world space translation stimulus may include at leastone of a voice command, a hand posture, a hand gesture, a stylusposture, a stylus gesture, an eye gesture, and a brainwave modulation.The world space resizing stimulus may include a user input. The worldspace resizing stimulus may include a voice command, a hand posture, ahand gesture, a stylus posture, a stylus gesture, an eye gesture, and/ora brainwave modulation. The sphere space rotation stimulus may include auser input. The sphere space rotation stimulus may include a voicecommand, a hand posture, a hand gesture, a stylus posture, a stylusgesture, an eye gesture, and/or a brainwave modulation. The sphere spacetranslation stimulus may include a user input. The sphere spacetranslation stimulus may include a voice command, a hand posture, a handgesture, a stylus posture, a stylus gesture, an eye gesture, and/or abrainwave modulation. The sphere space resizing stimulus may include auser input. The sphere space resizing stimulus may include a voicecommand, a hand posture, a hand gesture, a stylus posture, a stylusgesture, an eye gesture, and/or a brainwave modulation. The displayspace rotation stimulus may include a user input. The display spacerotation stimulus may include a voice command, a hand posture, a handgesture, a stylus posture, a stylus gesture, an eye gesture, and/or abrainwave modulation. The display space translation stimulus may includea user input. The display space translation stimulus may include a voicecommand, a hand posture, a hand gesture, a stylus posture, a stylusgesture, an eye gesture, and/or a brainwave modulation. The displayspace resizing stimulus may include a user input. The display spaceresizing stimulus may include a voice command, a hand posture, a handgesture, a stylus posture, a stylus gesture, an eye gesture, and/or abrainwave modulation.

The translation by the user may include constructive translation. Therotation by the user may include constructive rotation.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

Like reference numbers generally indicate corresponding elements in thefigures.

FIG. 1A shows an embodiment of a world space mode of an interfaceaccording to the present embodiment, with a viewer disposed therein.

FIG. 1B shows an example embodiment of a world space mode of aninterface according to the present embodiment, following a translationof the viewer therein.

FIG. 1C shows an example embodiment of a world space mode of aninterface according to the present embodiment, following a rotation ofthe viewer therein.

FIG. 2A shows an example embodiment of a sphere space mode of aninterface according to the present embodiment, with a viewer therein.

FIG. 2B shows an example embodiment of a sphere space mode of aninterface according to the present embodiment, following a translationof the viewer therein.

FIG. 2C shows an example embodiment of a sphere space mode of aninterface according to the present embodiment, following a rotation ofthe viewer therein.

FIG. 3A shows an example embodiment of a display space mode of aninterface according to the present embodiment, with a viewer therein.

FIG. 3B shows an example embodiment of a display space mode of aninterface according to the present embodiment, following a translationof the viewer therein.

FIG. 3C shows an example embodiment of a display space mode of aninterface according to the present embodiment, following a rotation ofthe viewer therein.

FIG. 3D shows an example embodiment of a display space mode of aninterface according to the present embodiment, following a rotation ofthe display space.

FIG. 3E shows an example embodiment of a display space mode of aninterface according to the present embodiment, following a translationof the display space.

FIG. 3F shows an example embodiment of a display space mode of aninterface according to the present embodiment, following a resizing ofthe display space.

FIG. 4A shows another example embodiment of a display space mode of aninterface according to the present embodiment, with a viewer therein.

FIG. 4B shows an example embodiment of a display space mode of aninterface according to the present embodiment, following a translationof the viewer therein.

FIG. 4C shows an example embodiment of a display space mode of aninterface according to the present embodiment, following a rotation ofthe viewer therein.

FIG. 5A shows another example embodiment of a combined world space,sphere space, and display space according to the present embodiment,with a viewer therein.

FIG. 5B shows an example embodiment of a combined world, sphere, anddisplay spaces according to the present embodiment, following atranslation of the viewer therein.

FIG. 5C shows an example embodiment of a combined world space, spherespace, and display space according to the present embodiment, followinga rotation of the viewer therein.

FIG. 6 shows an example embodiment of a method for interacting with aninterface using world space, sphere space, and display space accordingto the present embodiment.

FIG. 7A shows another example embodiment of a method for interactingwith an interface using world space, sphere space, and display spaceaccording to the present embodiment, also enabling exceptions to defaultinteraction behavior thereof.

FIG. 7B shows another example embodiment of a method for interactingwith an interface using world space, sphere space, and display spaceaccording to the present embodiment, also enabling exceptions to defaultinteraction behavior thereof.

FIG. 8 shows an example embodiment of an apparatus for interacting withan interface using world space, sphere space, and display spaceaccording to the present embodiment in schematic form.

FIG. 9 shows another embodiment of an apparatus according to the presentembodiment in schematic form, with dual sensors and outputters.

FIG. 10 shows another embodiment of an apparatus according to thepresent embodiment in schematic form, with support for enablingexceptions to default interaction behavior.

FIG. 11 shows a perspective view of an example apparatus according tothe present embodiment, in the form of a head-mounted display.

FIG. 12 shows an example embodiment of a method for establishing aninterface having world space, sphere space, and display space accordingto the present embodiment

FIG. 13 shows another embodiment of a method for establishing aninterface according to the present embodiment, enabling exceptions todefault interaction behavior.

FIG. 14 shows an example embodiment of a method for controlling aprocessor by interacting with an interface using world space, spherespace, and display space according to the present embodiment.

FIG. 15A through FIG. 15C shows another example embodiment of a methodfor controlling a processor by interacting with an interface using worldspace, sphere space, and display space according to the presentembodiment.

DETAILED DESCRIPTION OF THE EMBODIMENT

The present embodiment includes or at least may include multipleinterface modes. As each such mode may include unique features and/orbehaviors, modes are initially described individually herein forclarity.

With reference to FIG. 1A, a top-down view of an example embodiment of aworld space mode of an interface according to the present embodiment isshown therein. The world space proper in the example of FIG. 1A isidentified as 102A. The world space 102A is not shown as being bounded,and in at least some embodiments the world space 102A may not be boundedor may have boundaries that are not well-defined. Such an arrangementmay resemble in at least some senses that of a physical world, whereinthe boundaries thereof may not necessarily be well-defined. Consideringthe Earth as an example, the surface thereof is certainly finite but isat least arguably unbounded, at least insofar as the Earth is consideredas a surface since it is possible to translate and/or rotateindefinitely on the surface of the Earth without leaving the Earth.Furthermore, the world space 102A may not be a tangible “thing” per se,but rather may be considered as a space, environment, and/or portion ofan environment. That is, the world space 102A may be considered as aplace, e.g. a place that enables content to be disposed therein, thatsupports user actions (and/or potentially enables user actions to beprocessed as system inputs), that enables expression of system eventsand/or outputs, etc. The world space 102A might also be considered to bea collection of rules, behaviors, etc. that define the manner by whichinteraction between a user and a system (and potentially contentassociated with the world space 102. A within the system, etc.) may becarried out. Although the world space 102A is labeled in FIG. 1A forclarity, in practice a world space 102A will not necessarily have anyvisible presence or otherwise be directly sensible to a user thereof(though visibility is not excluded).

Depending upon the particular embodiment, world space 102A may be orinclude, in whole or in part, a virtual environment, an augmentedreality environment, a physical environment, or some other environment(e.g. an abstract digital construct with no geometry to output).

Four registration marks 104A-B, 104A-B, 104A-C, and 104A-D are shown inFIG. 1A. The registration marks 104A-A through 104A-D are shown hereinfor illustrative purposes, so as to make certain translations,rotations, etc. more readily apparent. Registration marks 104A-A through104A-D may or may not be present at all in actual embodiments of worldspace 102A, and when present may or may not be visible.

A user or viewer 106A of the interface is shown disposed within worldspace 102A. Depending on the particulars of a given embodiment, theviewer 106A may be physically present within world space 102A, may berepresented within world space 102A by a virtual reality and/oraugmented reality avatar, and/or may exist within world space 102 as apoint of view with no physical form and/or no visible appearance. Forclarity, the viewer 106A is shown in FIG. 1A (and elsewhere herein,unless otherwise noted) as a physical human presence, but this is anexample only and other arrangements may be equally suitable.

In addition, several example entities 108A-B, 108A-B, 108A-C, and 108A-Dare shown disposed within world space 102A. With regard to the presentembodiment, the term “entity” encompasses constructs that represent oneor more objects, phenomena, locales, environments, etc., as disposedwithin one or more spaces (e.g. world space 102A). Depending on theparticulars of an embodiment and the spaces therein, entities 108A-Bthrough 108A-D may be physical entities, virtual reality entities,augmented reality entities, and/or other entities (e.g. a freestandinglight effect or hologram, which might in some circumstances arguably beconsidered non-physical even if the light thereof exists within physicalreality).

The entities 108A-B through 108A-D as shown in FIG. 1A are present onlyfor illustrative purposes, and are not meant to visually represent anyparticular entity. However, as a more concrete example, for a worldspace 102A of a virtual environment, entities 108A-B through 108A-Dmight include but are not limited to text, images, icons for data filesand/or programs, virtual objects appropriate to some virtual environment(e.g. a virtual treasure chest in a pirate game), images, sounds,lighting effects and/or other visual effects, wireframes, models,avatars e.g. representing other users, virtual persons, virtualcreatures, etc. The aforementioned are examples only, and otherarrangements may be equally suitable.

Notice should be taken of the approximate position and orientation ofthe viewer 106A in FIG. 1A within world space 102A, with respect to theregistration marks 104A-A through 104A-D and the entities 108A-B through108A-D.

Turning now to FIG. 1B, an arrangement similar to that in FIG. 1A isshown, but with the viewer 106B having translated forward some distancewithin world space 102B, as may be seen with respect to the registrationmarks 104B-A through 104B-D and the entities 108B-B through 108B-Dtherein.

Thus, as shown, translation of the viewer 106B—for example with respectto some external coordinate system, including but not limited to acoordinate system associated with the physical world—substantiallycorresponds with translation with respect to world space 102B. Thedirection and distance of translation by the viewer 106B correspondssubstantially with the direction and distance that the viewer moves(and/or for certain embodiments may appear to move) within and/or withrespect to world space 102B. More simply, as the viewer 106B translates,the viewer 106B translates within world space 102B.

Likewise, for entities 108B-A through 108B-D disposed within world space102B, and that are stationary within world space 102B, translation ofthe viewer 106B substantially corresponds with translation with respectto those entities 108B-A through 108B-D. Again, as the viewer 106Btranslates, the viewer 106B translates through the entities 108B-Athrough 108B-D in world space 102B.

For example, considering entities 108B-A through 108B-D, as the viewer106B translates the distance between the viewer 106B and each entity108B-A through 108B-D will change as though the viewer 106B were movingwith respect to the entities 108B-A through 108B-D. Similarly, thedirection from the viewer 106B to each of the entities 108B-A through108B-D will change as though the viewer 106B were moving with respect tothe entities 108B-A through 108B-D.

Thus, for example for purposes of vision, for any of entities 108B-Athrough 108B-D that are within the field of view of the viewer 106B, theapparent position of those entities 108B-A through 108B-D within thatfield of view, the apparent size of those entities 108B-A through 108B-Dappear, what facings (if any) of those entities 108B-A through 108B-D(for arrangements wherein one or more of entities 108B-A through 108B-Dhave multiple facings, e.g. if one or more of entities 108B-A through108B-D is a 3D object), etc. will vary in a manner substantiallycorresponding with a translation by the viewer 106B with respect toworld space 102B.

Although the entities 108B-A through 108B-D in the example of FIG. 1Bare shown to be stationary for purposes of simplicity, the presentembodiment is not limited only to stationary entities. It will beunderstood that motions of entities within world space 102B also mayimpact apparent positions, motions, etc. with respect to the viewer106B.

Also, although FIG. 1B shows translation only in two dimensions, thepresent embodiment is not limited only to two dimensions. Viewers 106Bmay translate in three dimensions, with substantially correspondingthree-dimensional translation with respect to world space 102B and/or toentities 108B-A through 108B-D disposed therein.

Further, with regard to the use of the term “translation” (andsubsequently also “rotation”, below), for at least some embodiments theviewer 106B may, in fact, be moving with respect to an externalcoordinate system and/or with respect to world space 102B. However,arrangements wherein the viewer 106B does not move also may be equallysuitable. For example, insofar as the viewer 106B and the world space1028 are concerned, an arrangement wherein the viewer 106B has movedforward with respect to the world space 102B is similar to anarrangement wherein the world space 1028 has moved backward with respectto the viewer 106B. Arrangements wherein the world space 102B moves inaddition to or instead of the viewer 106B might be useful, for example,in outputting an apparently large virtual environment for a viewer whosephysical body is disposed within a smaller physical environment. Bymoving the environment relative to the viewer, the need for the viewerto move (i.e. with respect to the physical world) may be reduced or eveneliminated. However, other arrangements may be equally suitable.

Moving on, FIG. 10 shows an arrangement similar to that in FIG. 1B, butwith the viewer 106C having rotated clockwise approximately 90 degreeswithin world space 102C, as may be seen with respect to the registrationmarks 104C-A through 104C-D and the entities 108C-B through 108C-Dtherein.

Thus, as shown, rotation of the viewer 106C substantially correspondswith rotation with respect to world space 102C. The direction and degreeof rotation by the viewer 106C correspond substantially with thedirection and distance that the viewer rotates (and/or for certainembodiments may appear to rotate) within and/or with respect to worldspace 102C. More simply, as the viewer 106C rotates, the viewer 106Crotates within world space 102C.

Likewise, for entities 108C-A through 108C-D disposed within world space102C, and that are stationary within world space 102C, rotation of theviewer 106C substantially corresponds with rotation with respect tothose entities 108C-A through 108C-D.

Although FIG. 10 shows rotation in a particular two-dimensional plane(i.e. a plane generally parallel to the ground), the present embodimentis not limited only to two dimensions. Viewers 106C may rotate in threedimensions, with substantially corresponding three-dimensional rotationwith respect to world space 1020 and/or to entities 108C-A through108C-D disposed therein.

With regard to the translation and rotation of the viewer, both withreference to FIG. 1A through FIG. 10 and elsewhere herein, the terms“translation” and “rotation” should be understood broadly at leastinsofar as physical translation and/or rotation are concerned. Forexample, consider the case of a mechanism or system that allows a userto walk or otherwise move while remaining in place. Such a system mightbe combined with a virtual reality and/or augmented reality environment,allowing a user to navigate through the virtual or augmented realityenvironment using natural walking motions, without the user necessarilymoving through the physical world. Put differently, a viewer mightexecute motions comparable to the motions associated with awalking-based translation, while remaining substantially in the samelocation within physical space. The term “constructive translation”might usefully be applied to describe such action. The term“constructive rotation” likewise might be applied to similar actiondirected toward rotation without necessarily being associated withactual rotation in physical space.

Even though a viewer engaging in constructive translation may nottranslate in physical space, constructive translation may for at leastsome embodiments still be recognizable as a translation for the purposesof the present embodiment and could be utilized and/or interpreted asinput comparable to actual translation within physical space. That is,even if a viewer does not translate in physical space, e.g. in the senseof walking from one point to another in a physical room or other space,the present embodiment may still consider and/or interpret certaininputs constructive translation—to be equivalent to translation. Thus,the constructive translation could still invoke a substantiallycorresponding translation with respect to world space. Constructiverotation likewise could still invoke a substantially correspondingrotation with respect to world space.

As a more extreme example, consider a case wherein a user might executenerve signals associated with walking, running, etc. without necessarilyeven making the associated physical motions of his or her own body. Suchan arrangement might be utilized for example by users suffering frompartial and/or full paralysis of certain body parts, during physicaltherapy, etc. In such case, the nerve impulses sent to the muscles mightthemselves be considered to produce a constructive translation and/orconstructive rotation for the purposes of the present embodiment,regardless of whether any physical body motion at all takes place.Potentially the nerve signals might be so interpreted as constructivetranslation and/or rotation even if those nerve signals do not reach therelevant muscles, and/or even if those nerve signals never leave thebrain (e.g. due to certain spinal or neurological conditions).

In view of this, the present embodiment is not necessarily limited toactual translation and/or rotation within physical space. Constructivetranslation, constructive rotation, etc. may for at least someembodiments of the present embodiment be equally suitable for thepurposes of the present embodiment, and unless otherwise specified theterms “translation” and “rotation” should be considered to encompasstherein constructive translation and constructive rotation,respectively.

Moving on to FIG. 2A, a top-down view of an example embodiment of asphere space mode of an interface according to the present embodiment isshown therein. The sphere space in FIG. 2A is identified as 210A,indicated by a circle (representing a three-dimensional sphere). Asdescribed previously with regard to world space, sphere space 210A maynot be a tangible thing, but rather may be considered as a space,environment, and/or portion of an environment. Like world space, spherespace 210A may be considered to be a place that enables content to bedisposed therein, that supports user actions (and/or potentially enablesuser actions to be processed as system inputs), that enables expressionof system events and/or outputs, etc. Also like world space, spherespace 210A may be considered to be a collection of rules, behaviors,etc. that define the manner by which interaction between a user and asystem (and potentially content associated with sphere space 210A withinthe system, etc.) may be carried out. Although the sphere space 210A islabeled in FIG. 2A for clarity, in practice a sphere space 210A will notnecessarily have any visible presence or otherwise be directly sensibleto a user thereof (though visibility is not excluded).

Depending upon the particular embodiment, sphere space 210A may be orinclude, in whole or in part, a virtual environment, an augmentedreality environment, a physical environment, or some other environment(e.g. an abstract digital construct with no geometry to output).

Despite the name “sphere space”, it is emphasized that sphere space 210Ais not required to be a sphere, and may or may not be spherical in form.Typically, though not necessarily, sphere space 210A may be defined atleast partially in terms of one or more spheres and/or spherical shell,with content disposed within such spheres and/or engaged with suchspherical shells. For example, the arrangement illustrated in FIG. 2Ashows a sphere space 210A in the form of a spherical shell with contentengaged therewith. However other shapes, including but not limited toplanes, cylinders, cubes, etc. may be equally suitable. Moreover, spherespace 210A is not required to have any defined geometry; sphere space isdistinguished from, for example, world space not necessarily by shape orby other geometric parameters but rather by behavior and/orfunctionality, that is, how sphere space (and/or content disposedtherein) reacts in response to factors including but not limited toviewer translation, viewer rotation, etc.

Returning to FIG. 2A, four registration marks 204A-B, 204A-B, 204A-C,and 204A-D are shown therein. The registration marks 204A-A through204A-D are shown herein for illustrative purposes, so as to make certaintranslations, rotations, etc. more readily apparent. Registration marks204A-A through 204A-D may or may not be present at all in actualembodiments of sphere space 210A, and when present may or may not bevisible.

A user or viewer 206A of the interface is shown disposed within spherespace 210A. In addition, two example entities 208A-A and 208A-B areshown disposed within sphere space 210A.

Notice should be taken of the approximate position and orientation ofthe viewer 206A in FIG. 2A within sphere space 210A, with respect to theregistration marks 204A-A through 204A-D and the entities 208A-B and208A-B.

Turning now to FIG. 2B, an arrangement similar to that in FIG. 2A isshown, but with the viewer 206B having translated forward as may be seenwith respect to the registration marks 204B-A through 204B-D. However,although the viewer 206B has translated with respect to the registrationmarks 204B-A through 204B-D, the viewer 206B has not translated withrespect to sphere space 210B or with respect to the entities 208B-A and208B-B disposed within sphere space 210B.

Rather, as may be seen, the arrangement of the viewer 206B with respectto both sphere space 210B and the entities 208B-A and 208B-B disposedwithin sphere space 210B is substantially unchanged. Translation by theviewer 206B thus corresponds with substantially zero translation withrespect to sphere space 210B. More simply, even if the viewer 206Btranslates, the viewer 206B does not translate within or with respect tosphere space 210B, and the viewer 2068 does not translate with respectto entities 208B-A and 208B-B disposed within sphere space 210B. Putdifferently, sphere space 210B and entities 208B-A and 208B-B thereintranslate with a viewer 2068 as that viewer 2068 translates.

Moving on, FIG. 2C shows an arrangement similar to that in FIG. 2B, butwith the viewer 206C having rotated clockwise approximately 60 degreesas may be seen with respect to the registration marks 204C-A through204C-D. In addition, it may be seen that the viewer 206C also hasrotated clockwise approximately 60 degrees with respect to the entities208C-A and 208C-B therein, and thus also with respect to sphere space210C.

Thus, as shown, rotation of the viewer 206C substantially correspondswith rotation with respect to sphere space 210C. The direction anddegree of rotation by the viewer 206C corresponds substantially with thedirection and distance that the viewer rotates within and/or withrespect to sphere space 210C. More simply, as the viewer 206C rotates,the viewer 206C rotates within sphere space 210C. Likewise, for entities208C-A and 208C-B disposed within sphere space 210C, and that arestationary within sphere space 210C, rotation of the viewer 206Csubstantially corresponds with rotation with respect to those entities208C-A and 208C-B.

Turning now to FIG. 3A, a top-down view of an example embodiment of adisplay space mode of an interface according to the present embodimentis shown therein. The display space in FIG. 3A is identified as 312A,indicated by a circle (representing a three-dimensional sphere). Asdescribed previously with regard to world space and sphere space,display space 312A may not be a tangible thing, but rather may beconsidered as a space, environment, and/or portion of an environment.Like world space and sphere space, display space 312A may be consideredto be a place that enables content to be disposed therein, that supportsuser actions (and/or potentially enables user actions to be processed assystem inputs), that enables expression of system events and/or outputs,etc. Also like world space and sphere space, display space 312A may beconsidered to be a collection of rules, behaviors, etc. that define themanner by which interaction between a user and a system (and potentiallycontent associated with display space 312A within the system, etc.) maybe carried out. Although the display space 312A is labeled in FIG. 3Afor clarity, in practice a display space 312A will not necessarily haveany visible presence or otherwise be directly sensible to a user thereof(though visibility is not excluded).

Depending upon the particular embodiment, display space 312A may be orinclude, in whole or in part, a virtual environment, an augmentedreality environment, a physical environment, or some other environment(e.g. an abstract digital construct with no geometry to output).

Display space 312A may be defined at least partially in terms of one ormore geometrical forms such as a sphere, a spherical shell, a plane,etc., with content disposed therein and/or thereon. For example, thearrangement illustrated in FIG. 3A shows a display space 312A in theform of a spherical shell with content engaged therewith. However othershapes, including but not limited to planes, cylinders, cubes, etc. maybe equally suitable. Moreover, display space 312A is not required tohave any defined geometry; display space is distinguished from, forexample, world space and/or sphere space not necessarily by shape or byother geometric parameters but rather by behavior and/or functionality,that is, how display space (and/or content disposed therein) reacts inresponse to factors including but not limited to viewer translation,viewer rotation, etc.

Although sphere space as show in FIG. 2A through FIG. 2C and displayspace as shown in FIG. 3A through FIG. 3C are illustrated similarly,i.e. as being generally circular in form, this is an example only. It isnot required that sphere space and display space will have similargeometry or form (if either or both has geometry or form at all, asnoted above).

Returning to FIG. 3A, four registration marks 304A-B, 304A-B, 304A-C,and 304A-D are shown therein. The registration marks 304A-A through304A-D are shown herein for illustrative purposes, so as to make certaintranslations, rotations, etc. more readily apparent. Registration marks304A-A through 304A-D may or may not be present at all in actualembodiments of display space 310A, and when present may or may not bevisible.

A user or viewer 306A of the interface is shown disposed within displayspace 312A. In addition, two example entities 308A-A and 308A-B areshown disposed within display space 312A.

Notice should be taken of the approximate position and orientation ofthe viewer 306A in FIG. 3A within display space 312A, with respect tothe registration marks 304A-A through 304A-D and the entities 308A-A and308A-B.

Turning now to FIG. 3B, an arrangement similar to that in FIG. 3A isshown, but with the viewer 306B having translated forward as may be seenwith respect to the registration marks 304B-A through 304B-D. However,although the viewer 306B has translated with respect to the registrationmarks 304B-A through 304B-D, the viewer 306B has not translated withrespect to display space 312B or with respect to the entities 308B-A and308B-B disposed within display space 312B.

Rather, as may be seen, the arrangement of the viewer 306B with respectto both display space 312B and the entities 308B-A and 308B-B disposedwithin display space 312B is substantially unchanged. Translation by theviewer 306B thus corresponds with substantially zero translation withrespect to display space 312B. More simply, even if the viewer 306Btranslates, the viewer 306B does not translate within or with respect todisplay space 312B, and the viewer 306B does not translate with respectto entities 308B-A and 308B-B disposed within display space 312B. Putdifferently, display space 312B and entities 308B-A and 308B-B thereintranslate with a viewer 306B as that viewer 306B translates.

Moving on, FIG. 3C shows an arrangement similar to that in FIG. 3B, butwith the viewer 306C having rotated clockwise approximately 60 degreesas may be seen with respect to the registration marks 304C-A through304C-D. However, although the viewer 306C has rotated with respect tothe registration marks 304B-A through 304B-D, the viewer 306C has notrotated with respect to display space 312C or with respect to theentities 308C-A and 308C-B disposed within display space 312C.

Rather, as may be seen, the arrangement of the viewer 306C with respectto both display space 312C and the entities 308C-A and 308C-B disposedwithin display space 312C is substantially unchanged. Rotation by theviewer 306C thus corresponds with substantially zero rotation withrespect to display space 312C. More simply, even if the viewer 306Crotates, the viewer 306C does not rotate within or with respect todisplay space 312C, and the viewer 306C does not rotate with respect toentities 308C-A and 308C-B disposed within display space 312C. Putdifferently, display space 312C and entities 308C-A and 308C-B thereinrotate with a viewer 306C as that viewer 306C rotates.

It may be useful to briefly sum certain behaviors as thus far describedwith respect to world space, sphere space, and display space.

For world space, translation by a viewer substantially corresponds withtranslation with respect to world space, and rotation by the viewersubstantially corresponds with rotation with respect to world space. Inother words, a viewer typically translates through world space androtates within world space, so that changes in the appearance and/orposition of entities (and potentially world space itself, if visible)may result from translation and/or rotation.

For sphere space, translation by a viewer corresponds with substantiallyzero translation with respect to sphere space, and rotation by theviewer substantially corresponds with rotation with respect to thesphere space. In other words, sphere space typically translates with aviewer, while the viewer rotates within sphere space, so that changes inthe appearance and/or position of entities (and potentially sphere spaceitself, if visible) may result from the rotation, but not fromtranslation. From the point of view of the viewer, sphere space remainssubstantially aligned with the viewer as the viewer moves, but theviewer may rotate within sphere space to view different portionsthereof.

For display space, translation by a viewer corresponds withsubstantially zero translation with respect to sphere space, androtation by the viewer corresponds with substantially zero rotation withrespect to the display space. In other words, display space typicallytranslates and rotates with a viewer, so that changes in the appearanceand/or position of entities (and potentially display space itself, ifvisible) typically do not result from either translation or rotation.From the point of view of the viewer, display space remainssubstantially aligned with the viewer as the viewer moves and as theviewer rotates.

However, as may be seen with respect to FIG. 3D, the aforementionedbehaviors are not necessarily entirely fixed. The behaviors aspreviously described with regard to world space, sphere space, anddisplay space might for at least some embodiments be more properlyconsidered to be default behaviors rather than absolute restrictions.Under certain circumstances for at least some embodiments, otherbehaviors may be exhibited.

FIG. 3D shows an arrangement similar to that in FIG. 3C, but withdisplay space 312D having rotated clockwise approximately 30 degrees ascompared with FIG. 3C, as may be seen with respect to the registrationmarks 304D-A through 304D-D. It is also noted that the viewer 306D inFIG. 3D is substantially unchanged compared with FIG. 3C. That is,display space 312D has rotated without the viewer 306D having rotated.

As previously described, typically display space 312D rotates with theviewer 306D, such that there is substantially zero relative rotation ofthe display space 312D with respect to the viewer 306D. However, for atleast some embodiments it may be useful to enable rotation of thedisplay space 312D with respect to the viewer 306D, under at least somecircumstances. For example, if display space 312D includes aninformational entity that indicates and/or displays incoming messages,it may be useful to dispose such an entity in display space such thatthe entity is in the viewer's peripheral vision; the viewer may be madeaware (e.g. through blinking or some other phenomenon sensible viaperipheral vision) that a messages has been received, without themessage necessarily obscuring the viewer's vision for other tasks (e.g.crossing a busy street). With the message entity in display space,regardless of how the viewer translates and/or rotates the messageentity may remain in his or her peripheral visual field (neitherobscuring central vision nor leaving the visual field altogether).However, if at some point the viewer wishes to stop and read an incomingmessage, it may be useful to enable rotation of the display space, sothat the viewer may move the message entity into his or her centralvision to be read.

Such an arrangement might be considered to be a suspension or an“override” of the default behavior of the display space. Enablingrotation of the display space as described would not necessarily alterthe more general behavior of the display space as described previouslywith regard to FIG. 3A through FIG. 3C, but could rather allow for anexception to the default behavior.

For embodiments wherein such exceptions are utilized, it may further beuseful to arrange to invoke such exceptions using some stimulus. Forexample, a display rotation stimulus (i.e. to produce rotation of adisplay space relative to a viewer) might include a user input. Moreparticularly, a display rotation stimulus might include but is notnecessarily limited to, a voice command, a hand posture or gesture, astylus posture or gesture, an eye posture or gesture, or even amodulation of a viewer's brainwave pattern. These are examples only, andother stimuli may be equally suitable, e.g. mechanical inputs such askeyboard commands.

As may be seen with regard to FIG. 3E, exceptions to the defaultbehavior for display space are not necessarily limited only torotations.

FIG. 3E shows an arrangement similar to that in FIG. 3D, but withdisplay space 312E having translated downward and to the left ascompared with FIG. 3D, as may be seen with respect to the registrationmarks 304E-A through 304E-D. It is also noted that the viewer 306E inFIG. 3E is substantially unchanged compared with FIG. 3D. That is,display space 312E has translated without the viewer 306E havingtranslated.

As previously described, typically display space 312E translates withthe viewer 306E, such that there is substantially zero relativetranslation of the display space 312E with respect to the viewer 306E.However, for at least some embodiments it may be useful to enabletranslation of the display space 312E with respect to the viewer 306E,under at least some circumstances.

For embodiments wherein such exceptions are utilized, it may further beuseful to arrange to invoke such exceptions using some stimulus. Forexample, a display translation stimulus (i.e. to produce a translationof a display space relative to a viewer) might include a user input.More particularly, a display translation stimulus might include but isnot necessarily limited to, a voice command, a hand posture or gesture,a stylus posture or gesture, an eye posture or gesture, or even amodulation of a viewer's brainwave pattern. These are examples only, andother stimuli may be equally suitable, e.g. mechanical inputs such askeyboard commands.

In addition, it is noted that exceptions are not limited only topositive changes. For example, while typically translation by a viewermay produce a corresponding translation within world space (as notedwith regard to FIG. 3B), for at least certain embodiments it may bedesirable for translation by a viewer not to produce correspondingtranslation within world space. As a more concrete example, consider aviewer interacting with world space within a moving vehicle such as anautomobile. The viewer may be moving within the physical environment athighway speeds (e.g. 65 miles per hour). It may not necessarily bedesirable in all instances for the viewer to likewise move through aworld space at such speeds. Thus, an exception to the typical worldspace behavior might be implemented. Such an exception may be triggeredfor example by a gesture, verbal command, etc. as a viewer boards avehicle, but also might be partially or entirely automated, for examplethrough communication with sensors on the vehicle that provideinformation regarding the motion of the vehicle (as distinct from themotion of the viewer within the vehicle), so as to automatically excludevehicle translations from being expressed as substantially correspondingtranslations within world space.

Thus, for purposes of the present embodiment, a world space translationresponse of a translation of the world space relative to the viewer thatdoes not correspond with the translation by the viewer should beunderstood to include (but not be limited to) any translation of worldspace relative to the viewer, positive or negative, not substantiallycorresponding with the translation by the viewer. This applies equallyto exceptions for world space rotation, sphere space translation, spherespace rotation, display space translation, and display space rotation.

Turning to FIG. 3F shows an arrangement similar to that in FIG. 3E, butwith display space 312F having been resized, and more particularlyhaving been made smaller, as compared with FIG. 3E, as may be seen withrespect to the registration marks 304F-A through 304F-D. It is alsonoted that the viewer 306F in FIG. 3F is substantially unchangedcompared with FIG. 3E. That is, display space 312F has been resizedwithout the viewer 306F having been resized (as might be possible with avirtual avatar), translated, rotated, or otherwise having been visiblyaltered.

Although typically (though not necessarily) a display space may maintaina consistent size as a default behavior, for at least some embodimentsit may be useful to enable resizing of the display space 312F withrespect to the viewer 306F, under at least some circumstances.

For embodiments wherein such functionality is enabled, it may further beuseful to arrange to invoke such functions using some stimulus. Forexample, a display resizing stimulus (i.e. to produce resizing of adisplay space relative to a viewer) might include a user input. Moreparticularly, a display resizing stimulus might include but is notnecessarily limited to, a voice command, a hand posture or gesture, astylus posture or gesture, an eye posture or gesture, or even amodulation of a viewer's brainwave pattern. These are examples only, andother stimuli may be equally suitable, e.g. mechanical inputs such askeyboard commands.

It is emphasized that rotation, translation, and/or resizing asdescribed are examples only. Such exceptional behaviors may be usefulfor certain embodiments but are not required. Moreover, otherexceptional behaviors might be equally suitable, including but notlimited to resizing entities in display space, making entities indisplay space invisible or less visible (e.g. by reducing opacitythereof), etc.

Furthermore, it will be understood that similar exceptions may be usefulfor at least some embodiments with regard to world space and/or spherespace. Thus, world rotation stimuli, world translation stimuli, worldresizing stimuli, sphere rotation stimuli, sphere translation stimuli,sphere resizing stimuli, etc., may be utilized to similarly producerotation, translation, resizing, etc. for world space and/or spherespace.

Moving on to FIG. 4A, as previously stated display space, may takevarious forms (as may sphere space and world space). Where FIG. 3A showsa display space generally in the form of a spherical shell, FIG. 4Ashows a display space 412A generally in the form of a finite planedisposed in front of a viewer 406A. Entities 408A-A, 408A-B, and 408A-Care disposed in display space. Registration marks 404A-A, 404A-B,404A-C, and 404A-D also are shown for reference.

Notice should be taken of the approximate position and orientation ofthe viewer 406A in FIG. 4A with respect to display space 412A and withrespect to the registration marks 404A-A through 404A-D and the entities408A-B through 408A-C.

Turning now to FIG. 4B, an arrangement similar to that in FIG. 4A isshown, but with the viewer 406B having translated forward as may be seenwith respect to the registration marks 404B-A through 404B-D. Again,however, although the viewer 406B has translated with respect to theregistration marks 404B-A through 404B-D, the viewer 406B has nottranslated with respect to display space 412B or with respect to theentities 408B-A through 308B-C disposed within display space 412B.Rather, translation by the viewer 406B thus corresponds withsubstantially zero translation with respect to display space 412B.

Moving on, FIG. 4C shows an arrangement similar to that in FIG. 4B, butwith the viewer 406C having rotated clockwise approximately 60 degreesas may be seen with respect to the registration marks 404C-A through404C-D. However, although the viewer 406C has rotated with respect tothe registration marks 404C-A through 404C-D, the viewer 406C has notrotated with respect to display space 412C or with respect to theentities 408C-A through 408C-C disposed within display space 412C.Rather, rotation by the viewer 306C thus corresponds with substantiallyzero rotation with respect to display space 312C.

It is emphasized, as may be seen by comparison of FIG. 3A through FIG.3C against FIG. 4A through FIG. 4C, that the configuration, form, etc.of display space does not necessarily affect the behavior and/orfunction of display space. Likewise, the configuration, form, etc. ofsphere space and/or world space also does not necessarily affect thebehavior and/or function of sphere space and/or world space.

Moving on, where FIG. 1A through FIG. 10 showed world spaceindividually, FIG. 2A through FIG. 2C showed sphere space individually,and FIG. 3A through FIG. 3C and FIG. 4A through FIG. 4C showed displayspace individually, FIG. 5A through FIG. 5C show an arrangement with aworld space mode, a sphere space mode, and a display space modetogether.

With reference now to FIG. 5A, a viewer 506A is shown therein. Referencemarks 504A-A, 504A-A, 504A-A, and 504A-A are shown so as to make certaintranslations, rotations, etc. more readily apparent.

Also shown in FIG. 5A is a world space 502A (illustrated as beingunbounded, similarly to FIG. 1A through FIG. 10), a sphere space 510A(illustrated as a circle substantially centered on the viewer 506A,similarly to FIG. 2A through FIG. 2C), and a display space 512A(illustrated as a finite plane disposed in front of the viewer 506A,similarly to FIG. 4A through FIG. 4C).

A number of example entities are also shown in FIG. 5A, each beingdisposed in one of world space 502A, sphere space 510A, and displayspace 512A. More particularly, entities 508A-B, 508A-B, 508A-C, and508A-D are shown disposed in world space 502A, entities 508A-E and508A-F are shown disposed in sphere space 510A, and entities 508A-G and508A-H are shown disposed in display space 512A.

No distinction is illustrated between the entities 508A-A through 508A-Hbased on whether they are disposed within world space 502A, sphere space510A, or display space 512A. This is deliberate and illustrates that aparticular entity is not necessarily limited to any of world space 502A,sphere space 510A, and display space 512A, nor are any of world space502A, sphere space 510A, and display space 512A limited insofar as towhat entities may be disposed therein.

In addition, entities are not necessarily prohibited from moving, beingcopied, or otherwise transitioning among world space 502A, sphere space510A, and display space 512A; for at least some embodiments, movingentities from (for example) sphere space 510A to display space 512A,etc. may be enabled.

Furthermore, the presence of world space 502A, sphere space 510A, anddisplay space 512A should not be taken to imply that the presence ofother spaces is necessarily excluded or restricted. While certainembodiments may utilize only world space 502A, sphere space 510A, anddisplay space 512A, other embodiments may utilize additional spaces,including but not limited to a file storage space, a hidden“hammerspace”, etc. Likewise, for at least certain embodiments entitiesmay be enabled to be moved, copied, etc. among world space 502A, spherespace 510A, and display space 512A and any other space(s) that may bepresent.

Moving on to FIG. 5B, an arrangement similar to that in FIG. 5A isshown, but with the viewer 506B having translated forward some distanceas may be seen with respect to the registration marks 504B-A through504B-D.

A comparison of FIG. 5B with FIG. 5A reveals several features regardingthe relationships between the viewer 506B and world space 502B, spherespace 510B, and display space 512B, and between the viewer 506B and theentities 508B-A through 508R-H disposed in world space 502B, spherespace 510B, and display space 512B. Translation of the viewer 506Bsubstantially corresponds with translation with respect to world space502B, and with respect to the entities 508B-A through 508B-D disposedtherein. However, translation by the viewer 506B corresponds withsubstantially zero translation with respect to sphere space 5110B andwith respect to the entities 508B-E and 508B-F disposed therein.Translation by the viewer 506B also corresponds with substantially zerotranslation with respect to display space 512B and with respect to theentities 508B-G and 508B-H disposed therein.

Continuing with FIG. 5C, therein is shown an arrangement similar to thatin FIG. 5B, but with the viewer 506C having rotated clockwiseapproximately 90 degrees as may be seen with respect to the registrationmarks 504C-A through 504C-D.

Again, a comparison of FIG. 5C with FIG. 5B reveals several featuresregarding the relationships between the viewer 506C and world space502C, sphere space 510C, and display space 5120, and between the viewer506C and the entities 508C-A through 508C-H disposed in world space502C, sphere space 510C, and display space 512C. Rotation of the viewer5060 substantially corresponds with rotation with respect to world space502C, and with respect to the entities 508C-A through 508C-D disposedtherein. Similarly, rotation of the viewer 506C substantiallycorresponds with rotation with respect to sphere space 510C, and withrespect to the entities 508C-E and 508C-F disposed therein. However,rotation by the viewer 506C corresponds with substantially zero rotationwith respect to display space 512C and with respect to the entities508C-G and 508C-H disposed therein.

Thus, the behavior of world space, sphere space, and display spacetogether is similar to the behavior of world space, sphere space, anddisplay space individually as previously described herein. That is, forworld space translation by a viewer substantially corresponds withtranslation with respect to world space, and rotation by the viewersubstantially corresponds with rotation with respect to world space. Forsphere space, translation by a viewer corresponds with substantiallyzero translation with respect to sphere space, and rotation by theviewer substantially corresponds with rotation with respect to thesphere space. For display space, translation by a viewer correspondswith substantially zero translation with respect to display space, androtation by the viewer corresponds with substantially zero rotation withrespect to the display space.

It may at this point be illuminating to point out certain advantages ofthe present embodiment, relating at least in part to the combination ofworld space, sphere space, and display space therein. The advantagesand/or functions as presented are examples only, and the presentembodiment is not limited to those specifically described herein.

For example, as noted elsewhere herein entities may be transferred,copied, etc. among world space, sphere space, and display space. Thatis, an entity in world space could be either moved to world space, or acopy thereof made and left in world space with the original remaining indisplay space (potentially with a data link of some sort between theoriginal and the copy, e.g. a link that updates the copy in one space ifthe original in another space is modified). As a more concrete example,a user might create and/or edit an entity in display space or spherespace, spaces that (as described herein) tend to remain at a consistentdistance from the user, and which in the case of display space alsotends to remain at a consistent orientation relative to the user,features which may prove convenient for the creation and/or editing ofentities such as documents, images, etc. After creating and/or editingthe entity, the user might then move the entity to world space, forexample, to become part of a virtual “world”.

Conversely, a user might copy an entity from world space into spherespace or display space. As another more concrete example, a user mightdecide to create a label, leave a comment, establish a link, etc. for aworld space entity. The user could, for convenience, move or copy theentity into display space or sphere space for creating the label,comment, etc. Once finished, the user could transfer or copy the entity(with the label, comment, etc. added) back to world space.

In addition, for certain embodiments one or more spaces may be sharedspaces, that is, accessible, viewable, and/or editable by multipleusers. Conversely, one or more spaces may be personal or non-sharedspaces, that is, accessible, viewable, and/or editable only by a singleuser. For example, in some embodiments world space might be shared, i.e.as a wider virtual and/or augmented world, while sphere space and/ordisplay space in those embodiments are personal for each user. The useof multiple spaces as described herein enables the ability to readilytransfer entities between public, multi-user functionality and private,single-user functionality, and also to readily distinguish betweenpublic and private functionality.

Again as a more concrete example, the combination of world space, spherespace, and display space of the present embodiment could supportcollaborative work between multiple users (potentially at a considerabledistance within the physical world). Individuals could create and modifycontent within their personal sphere spaces and display spaces whilecontributing shared content within a shared world space.

It is noted that such shared spaces are not limited only to world space.For example, a single shared sphere space might be disposed surroundingmultiple users and/or avatars. Moreover, different spaces may be sharedto different degrees, for example, world space being accessible to allusers in a particular system, sphere space being accessible to a groupof users but not necessarily all users and display space beingaccessible only to a single user. Furthermore, the present embodiment isnot necessarily limited only to a single world space, sphere space,and/or display space. A group of users might establish and share asphere space surrounding those users (or avatars), for example, whileeach individual user also has a personal sphere space surrounding him orher. Multiple display spaces and/or multiple world spaces likewise maybe suitable for certain embodiments of the present embodiment.

In addition, with a distinct world space, sphere space, and displayspace established, that very distinction enables potentially usefulinteractions. As a simple example, a user might have or might create,one or more cursors or similar marking point within display space. Byaligning that cursor—and thus aligning display space—with some entitywithin sphere space or world space, the user might indicate theirselection of the entity within sphere space or world space. Since, asdescribed herein, display space is substantially stationary with regardto the position and orientation of the viewer—that is, from the viewer'spoint of view display space typically does not rotate or translate—auser can align display space by changing their facing, moving, etc.Through such an approach, a user could select entities in sphere spaceand/or world space without necessarily touching those entities, orexecuting similar manipulation. The combination of display space withsphere space and world space thus enables what might be considered“hands-free” manipulation of a virtual and/or augmented realityenvironment.

Furthermore, with distinct world space, sphere space, and display space,it is enabled to establish “markers” within one space that are linked toanother space. For example, consider a marker representing the locationof a restaurant in the world space of an augmented reality environment.While the restaurant marker may be in world space, a secondary markercould be established in display space and/or world space, for example asa pointer to the location of the marker in world space. While a usertypically moves through world space, and thus may be some considerabledistance from a marker therein (potentially also with obstructions tothe user's line of sight to the world space marker), sphere space anddisplay space typically translate with the user, and thus are in effectalways (or nearly always) nearby. Put differently, a user might not beable to see or interact with a world space marker that is many milesaway, but might more readily see, interact with, and/or even touch asphere space or display space marker since sphere space and displayspace move with the user.

As noted, these are examples only, and other functions and advantages ofthe present embodiment may exist besides those specifically describedherein.

Moving on to FIG. 6, therein is shown a method for interfacing with asystem according to the present embodiment. In the method, a world spaceis established 622. The nature and behavior of world space have beendescribed previously herein. Briefly, translation by a viewersubstantially corresponds with translation with respect to world space,and rotation by the viewer substantially corresponds with rotation withrespect to world space.

A sphere space also is established 624. The nature and behavior ofsphere space have also been described previously herein. Briefly,translation by a viewer corresponds with substantially zero translationwith respect to sphere space, and rotation by the viewer substantiallycorresponds with rotation with respect to the sphere space.

A display space is established 626. Again, the nature and behavior ofdisplay space have been described previously herein. Briefly,translation by a viewer corresponds with substantially zero translationwith respect to display space, and rotation by the viewer correspondswith substantially zero rotation with respect to the display space.

The term “establishing”, such as with regard to world space, spherespace, and display space, should be considered broadly. In establishingworld space, for example, world space may be loaded into a processorfrom stored executable instructions, may be defined as a rule set, maybe partitioned from another space (whether a real-world space, a virtualreality space, an augmented reality space, or otherwise), etc. It isnoted that such options—loading, defining, partitioning, etc.—are notnecessarily exclusive, and a single embodiment may utilize more thanone. So long as the end result is a world space as described herein, themanner by which the world space is established is not particularlylimited. Similarly, the present embodiment is not particularly limitedwith regard to the manner or manners by which sphere space and/ordisplay space are established.

For at least certain embodiments, establishing a world space, spherespace, and/or display space may include, but is not required to include,outputting the world space, sphere space, and/or display space.Likewise, establishing a world space, sphere space, and/or display spacemay include, but is not required to include, outputting entities (e.g.icons, controls, images, text, graphics, video feed, audio feed, etc.)within the world space, sphere space, and/or display space. For example,world space, sphere space, and/or display space, and/or content disposedtherein, may be visually outputted to the viewer through a head-mounteddisplay or another device. However, world space, sphere space, and/ordisplay space in and of themselves may or may not have any visibility(i.e. may be constructs of rules, data, etc. without directly visiblecontent); likewise although entities may be present and/or may bevisible if present within world space, sphere space, and/or displayspace, it is not required that such entities be present or be visible ifpresent.

Thus, while at least certain embodiments of the present embodiment mayinclude outputting visual content (and/or other sensory) for and/orassociated with a world space, sphere space, and/or display space, suchoutputting of visual content is not required for the present embodiment.

A determination is made 632 as to whether a viewer translation ispresent. If a viewer translation is not present, the method proceedswith step 640 below. If a viewer translation is present, the methodproceeds with step 634, namely, a substantially correspondingtranslation with respect to world space is manifested. Substantiallyzero translation with respect to sphere space is manifested 636, andsubstantially zero translation with respect to display space also ismanifested 638.

The present embodiment is not particularly limited with regard to howviewer translation may be determined. For at least some embodiments, itmay be useful to utilize sensors in communication with a processorcarrying out the method according to the present embodiment. Suitablesensors may include, but are not limited to, imagers (singly, in groups,in stereo configurations, etc.), structured light sensors,time-of-flight sensors, ultrasonic sensors, accelerometers, gyroscopes,UPS sensors, a magnetometers, and/or wireless signal triangulationsensors (including but not limited to wifi positioning sensors). Also,it is noted that sensors may for at least some embodiments be disposedon one or more viewers, e.g. in a portable device such as a head-mounteddisplay. However, these are examples only, and other arrangements may beequally suitable.

In addition, it may be suitable for at least some embodiments todetermine translation indirectly. That is, rather than determining thetranslation of the viewer per se, the translation and/or other motion ofsome sensor, marker, article of clothing, specific body part, etc. maybe utilized, with the translation of the viewer being inferred ordetermined therefrom. Moreover, for an embodiment wherein one or moresensors are disposed on the viewer (e.g. in a portable or wearabledevice), translation might be determined without sensing the viewer atall, but rather might rely upon sensing a surrounding environment andinferring a translation therefrom.

In such an arrangement, the sensors would not necessarily determine thetranslation of the viewer by sensing the viewer, but might instead sensechanges.

Depending on the particulars of an embodiment, manifesting a zero orsubstantially zero change in translation (and likewise rotation, below)may be passive in nature. That is, manifesting zero translation mayamount to taking no or substantially no action, i.e. not activelydetermining and/or applying a translation or other change. However, itis noted that even a zero translation with respect to, for example,sphere space, may nevertheless for other embodiments include activechanges. It is pointed out, for example with regard to FIG. 2B, that theposition of sphere space 210B as shown in FIG. 2B and the entities208B-A and 208B-B disposed therein translates or at least may translatewith respect to external coordinates (as may be noted by the change inposition between sphere space 210B and the registrations marks 204B-Athrough 204B-D as compared with FIG. 2A). Thus even if a viewerexperiences no translation with respect to sphere space, sphere spaceitself may nevertheless translate with respect to some other frame ofreference, and thus some active change to sphere space may occur even ifsuch change is not immediately apparent to the viewer.

Continuing in FIG. 6, a determination is made 640 as to whether a viewerrotation is present. If a viewer rotation is not present, the method iscomplete. If a viewer rotation is present, the method proceeds with step642, namely, a substantially corresponding rotation with respect toworld space is manifested. A substantially corresponding rotation withrespect to sphere space also is manifested 644. In addition,substantially zero translation with respect to display space ismanifested 646.

As stated previously with regard to translation, the present embodimentalso is not particularly limited with regard to how viewer rotation maybe determined. For at least some embodiments, it may be useful toutilize sensors in communication with a processor carrying out themethod according to the present embodiment. Suitable sensors mayinclude, but are not limited to, imagers (singly, in groups, in stereoconfigurations, etc.), structured light sensors, time-of-flight sensors,ultrasonic sensors, accelerometers, gyroscopes, GPS sensors, amagnetometers, and/or wireless signal triangulation sensors (includingbut not limited to wifi positioning sensors). Also, it is noted thatsensors may for at least some embodiments be disposed on one or moreviewers, e.g. in a portable device such as a head-mounted display.However, these are examples only, and other arrangements may be equallysuitable.

In addition, it may be suitable for at least some embodiments todetermine rotation indirectly. That is, rather than determining therotation of the viewer per se, the rotation and/or other motion of somesensor, marker, article of clothing, specific body part, etc. may beutilized, with the rotation of the viewer being inferred or determinedtherefrom. Moreover, for an embodiment wherein one or more sensors aredisposed on the viewer (e.g. in a portable or wearable device), therotation might be determined without sensing the viewer at all, butrather might rely upon sensing a surrounding environment and inferring arotation therefrom.

Although FIG. 6 shows the method therein as being complete followingstep 646, it is emphasized that the method in FIG. 6 is an example only.Other steps, other functions, etc. may be incorporated into the method,and/or other methods may be executed in combination with the methodaccording to the present embodiment. In addition, for at least certainembodiments the method may repeat, e.g. in an ongoing loop thatcontinues to sense for viewer translations and/or rotations and thatmanifests appropriate changes (and/or lack of same) in response thereto.Such an arrangement may, for example, provide what might be described asan ongoing, dynamic update of position and orientation of a viewer withrespect to world space, sphere space, and/or display space.

Turning now to FIG. 7A, as has been previously described (for examplewith regard to FIG. 3D through FIG. 3F) the present embodiment mayincorporate therein exceptions to the default behaviors associated withworld space, sphere space, and/or display space. Exceptions may includebut are not limited to rotation of sphere space with respect to aviewer, rotation and/or translation of display space with respect to theviewer, and resizing of one or more of world space, sphere space, anddisplay space. FIG. 7A shows an example method that enables such anexception.

In the method shown in FIG. 7A, a world space is established 722. Asphere space also is established 724, and a display space further isestablished 726.

In addition, an exception stimulus is established 728. As notedpreviously with regard to FIG. 3D through FIG. 3F, exceptions to thedefault behavior of world space, sphere space, and/or display space astimulus may be invoked through such an exception stimulus. Typically,though not necessarily, such an exception stimulus is or includes someaction on the part of the viewer, including but not limited to a voicecommand, a hand posture or gesture, a stylus posture or gesture, an eyeposture or gesture, or a modulation of a viewer's brainwave pattern. Inestablishing an exception stimulus 728, the particulars of an exceptionstimulus are determined. For example, if an exception stimulus is to beused to invoke an exception, the exception stimulus may be a handgesture and may be more particularly a specific hand gesture such as athumb-and-finger pinch, a two-finger click, a grab-and-twist, etc.

The present embodiment is not particularly limited insofar as whatstimuli may be utilized as exception stimuli. Furthermore, the presentembodiment is not particularly limited with regard to how exceptionstimuli may be established, or the form of exception stimuli. A handposture might specify the position of particular fingertips or otherend-effectors, or might specify a hand outline or profile shape, may ormay not utilize edge detection or color discrimination, may utilize avariety of algorithms and approaches for determining hand position, mayrely on different instruments (if any) for sensing hand position, etc.Typically, though not necessarily, an exception stimulus may beestablished 728 as mathematical or computational parameters, executableinstructions, etc. adapted to be utilized by a data processor. However,other arrangements may be equally suitable.

For embodiments having multiple exception stimuli, exception stimuli maybe defined and/or described individually, for example with reference tothe change associated with the exception. Thus, exception stimuli mightinclude, but are not limited to, a world rotation stimulus, a worldtranslation stimulus, a world resizing stimulus, a sphere rotationstimulus, a sphere translation stimulus, a sphere resizing stimulus, adisplay rotation stimulus, a display translation stimulus, and a displayresizing stimulus. Other stimuli than translation, rotation, andresizing, and/or other effects than translation, rotation, and resizing,may be equally suitable, and the present embodiment is not limited onlythereto.

Moving on in FIG. 7A, an exception response is established 730.

In establishing an exception response 730, the particulars of anexception response are determined. That is, does the exception responsein question include a translation of one or more of world space, spherespace, and display space, a rotation thereof, a resizing thereof, etc.

The present embodiment is not particularly limited insofar as whatactions may be utilized as exception responses. Furthermore, the presentembodiment is not particularly limited with regard to how exceptionresponses may be established, or the form of exception responses.Typically, though not necessarily, an exception response may beestablished 730 as mathematical or computational parameters, executableinstructions, etc. adapted to be utilized by a data processor, e.g. toenable the processor to execute a translation, rotation, resizing, etc.However, other arrangements may be equally suitable.

As with exception stimuli, for embodiments having multiple exceptionresponses the exception responses may be defined and/or describedindividually, for example with reference to the change associated withthe exception. Thus exception responses might include, but are notlimited to, a world rotation response, a world translation response, aworld resizing response, a sphere rotation response, a spheretranslation response, a sphere resizing response, a display rotationresponse, a display translation response, and a display resizingresponse.

Continuing in FIG. 7A, determination is made 732 as to whether a viewertranslation is present. If a viewer translation is not present, themethod proceeds with step 740 below. If a viewer translation is present,the method proceeds with step 734, namely, a substantially correspondingtranslation with respect to world space is manifested. Substantiallyzero translation with respect to sphere space is manifested 736, andsubstantially zero translation with respect to display space also ismanifested 738.

Moving on in FIG. 7A, a determination is made 740 as to whether a viewerrotation is present. If a viewer rotation is not present, the method iscomplete. If a viewer rotation is present, the method proceeds with step742, namely, a substantially corresponding rotation with respect toworld space is manifested. Continuing then in FIG. 7B, a substantiallycorresponding rotation with respect to sphere space also is manifested744. In addition, substantially zero translation with respect to displayspace is manifested 746.

A determination is made 748 as to whether the exception stimulus ispresent (the exception stimulus being established 728 as shown in FIG.7A). If the exception stimulus is not present, the method proceeds withstep 750 below. If the exception stimulus is present, the methodproceeds with step 748, namely, the exception response is executed (theexception response being established 730 as shown in FIG. 7A).

Although FIG. 7B shows the method therein as being complete followingstep 750, it is emphasized that the method in FIG. 7A and FIG. 7B is anexample only. Other steps, other functions, etc. may be incorporatedinto the method, and/or other methods may be executed in combinationwith the method according to the present embodiment. For example,although FIG. 7A and FIG. 7B show only a single exception stimulus and asingle exception response, multiple exception stimuli and/or multipleexception responses may be incorporated into at least some embodiments.In addition, for at least certain embodiments the method may repeat,e.g. in an ongoing loop that continues to sense for viewer translationsand/or rotations and that manifests appropriate changes (and/or lack ofsame) in response thereto.

Turning now to FIG. 8, a schematic diagram of an embodiment of anapparatus 870 for interfacing with a system according to the presentembodiment is shown therein.

The apparatus includes a processor 872 adapted for executing executableinstructions. The embodiment is not particularly limited with regard tothe choice of processor 872. Suitable data processors 872 include butare not limited to digital electronic microprocessors. Although theprocessor 872 is referred to in at least some places herein as aself-contained physical device for purposes of clarity, this is notrequired, and other arrangements may be suitable. For example, theprocessor 872 may constitute two or more physical processors workingcooperatively, a processing capability in a network without awell-defined physical form, etc.

The apparatus includes several elements shown to be instantiated on theprocessor 872. The aforementioned elements include a translationdeterminer 874, a rotation determiner 876, a world space controller 878,a sphere space controller 880, and a display space controller 882. Asshown in FIG. 8 the translation determiner 874, rotation determiner 876,world space controller 878, sphere space controller 880, and displayspace controller 882 are disposed on the processor 872. Typically thetranslation determiner 874, rotation determiner 876, world spacecontroller 878, sphere space controller 880, and display spacecontroller 882 include executable instructions and/or data, e.g.instantiated on the processor 872, and in at least some embodiments thetranslation determiner 874, rotation determiner 876, world spacecontroller 878, sphere space controller 880, and display spacecontroller 882 may be exclusively executable instructions and/or data.However, this is an example only.

For at least some embodiments any or all of the translation determiner874, rotation determiner 876, world space controller 878, sphere spacecontroller 880, and display space controller 882 may include componentsother than executable instructions and/or data. For example, any or allof the translation determiner 874, rotation determiner 876, world spacecontroller 878, sphere space controller 880, and di splay spacecontroller 882 may include some physical device such as an embeddedprocessor, a data input, a sensor, etc. However, for certain embodimentseven when such hardware is present, it may be suitable to consider suchhardware as being distinct from the translation determiner 874, rotationdeterminer 876, world space controller 878, sphere space controller 880,and/or display space controller 882. That is, while hardware (or othercomponents) may be present in addition to executable instructions and/ordata for at least some embodiments, the presence of hardware does notnecessarily imply that such hardware is or should be considered to bepart of the translation determiner 874, rotation determiner 876, worldspace controller 878, sphere space controller 880, and/or display spacecontroller 882.

Furthermore, for at least some embodiments any or all of the translationdeterminer 874, rotation determiner 876, world space controller 878,sphere space controller 880, and display space controller 882 mayexclude executable instructions and/or data. For example, any or allsuch might utilize hardware such as dedicated circuits adapted toperform the functions disclosed therefor (below) without necessaryincorporating and/or relying on executable instructions or datainstantiated on a processor.

Thus, depending on the particulars of a given embodiment, thetranslation determiner 874, rotation determiner 876, world spacecontroller 878, sphere space controller 880, and display spacecontroller 882 may be executable instructions and/or data only,executable instructions and/or data plus other components, or componentsexcluding executable instructions and/or data.

However, for purposes of clarity for the example embodiment shown inFIG. 8, the translation determiner 874, rotation determiner 876, worldspace controller 878, sphere space controller 880, and display spacecontroller 882 will be referred to in at least some places herein asbeing executable instructions and/or data instantiated on the processor872.

It is noted further that although the translation determiner 874,rotation determiner 876, world space controller 878, sphere spacecontroller 880, and display space controller 882 are shown and describedherein as being separate elements, this is done for clarity and shouldnot be taken to limit the present embodiment. For at least someembodiments, one or more of the translation determiner 874, rotationdeterminer 876, world space controller 878, sphere space controller 880,and display space controller 882 may be combined with one another,and/or may be incorporated into some larger construct, e.g. a singleprogram performing all functions thereof, a general operating system,etc.

Again with reference to FIG. 8, the translation determiner 874 isadapted to determine a translation of a person such as a viewer and/oruser of an augmented reality environment, virtual reality environment,etc. As noted above, typically although not necessarily the translationdeterminer 874 includes executable instructions and/or data instantiatedon a processor 872.

Typically but not necessarily, the translation determiner 874 is adaptedto determine both a direction and a distance of viewer translation.Other features of translation may be determined, including but notlimited to instantaneous speed, average speed over some time,instantaneous acceleration, average acceleration over some time, minimumand/or maximum speed, minimum and/or maximum acceleration, and distance,speed, and/or acceleration in individual components or coordinates (e.g.x, y, and z).

Typically although not necessarily, translation may be determined by thetranslation determiner 874 in three dimensions, although for at leastcertain embodiments determining translation in two dimensions or even inone dimension may be sufficient.

As previously noted with regard to FIG. 6, the manner by whichtranslation is determined is not particularly limited.

Still with regard to FIG. 8, the rotation determiner 876 is adapted todetermine a rotation of a person such as a viewer and/or user of anaugmented reality environment, virtual reality environment, etc. Asnoted above, typically although not necessarily the rotation determiner876 includes executable instructions and/or data instantiated on aprocessor 872.

Typically but not necessarily, the rotation determiner 876 is adapted todetermine both a direction and a degree of viewer rotation. Otherfeatures of rotation may be determined, including but not limited toidentifying an axis or axes thereof, instantaneous speed, average speedover some time, instantaneous acceleration, average acceleration oversome time, minimum and/or maximum speed, minimum and/or maximumacceleration, and distance, speed, and/or acceleration in individualcomponents or coordinates.

Typically although not necessarily, rotation may be determined by thetranslation determiner 874 with respect to three axes, although for atleast certain embodiments determining translation with respect to twoaxes or even one axis may be sufficient.

As previously noted with regard to FIG. 6, the manner by which rotationis determined is not particularly limited.

The world space controller 878 is adapted to determine a translation ofthe viewer with respect to world space that substantially correspondswith the translation of the viewer as determined by the translationdeterminer 874. The world space controller 878 also is adapted todetermine a rotation of the viewer with respect to world space thatsubstantially corresponds with the rotation of the viewer as determinedby the rotation determiner 876. For example, for certain embodiments theworld space controller 878 may determine suitable updates to world spaceas presented to the viewer (e.g. for a stereo visual output) such thatviewer translation produces substantially corresponding translation withrespect to world space, and viewer rotation produces substantiallycorresponding rotation with respect to world space.

The sphere space controller 880 is adapted to determine a translation ofthe viewer with respect to sphere space that substantially correspondswith the translation of the viewer as determined by the translationdeterminer 874. The sphere space controller 880 also is adapted todetermine a substantially zero rotation of the viewer with respect tosphere space regardless of the rotation of the viewer as determined bythe rotation determiner 876. For example, for certain embodiments thesphere space controller 880 may determine suitable updates to spherespace as presented to the viewer (e.g. for a stereo visual output) suchthat viewer translation produces substantially corresponding translationwith respect to sphere space, and viewer rotation produces substantiallyzero rotation with respect to sphere space.

The display space controller 882 is adapted to determine a substantiallyzero translation of the viewer with respect to display space regardlessof the translation of the viewer as determined by the translationdeterminer 874. The display space controller 882 also is adapted todetermine a substantially zero rotation of the viewer with respect todisplay space regardless of the rotation of the viewer as determined bythe rotation determiner 876. For example, for certain embodiments thedisplay space controller 882 may determine suitable updates to displayspace as presented to the viewer (e.g. for a stereo visual output) suchthat viewer translation produces substantially zero translation withrespect to display space, and viewer rotation produces substantiallyzero rotation with respect to display space.

It will be understood that determining a substantially zero translationand/or a substantially zero rotation does not necessarily equate tomaking zero change. For example, although a viewer that rotates mayexperience no change in the apparent position of display space, displayspace may in fact be rotating with the viewer so that the apparent lackof rotational change is maintained. Thus, determining substantially zerotranslation and/or substantially zero rotation do not necessarilyconstitute a simple lack of action, but rather may include computation,data manipulation, image processing, etc. so as to maintain what appearsto the viewer to be zero translation and/or zero rotation of certaincontent (e.g. content in sphere space, display space, etc.) even whenthe viewer may in fact be translating and/or rotating.

Still with reference to FIG. 8, the apparatus 870 includes a sensor 888in communication with the processor 872, and thus notably incommunication with the translation determiner 874 and rotationdeterminer 876 instantiate on the processor 872. The sensor is adaptedto sense translation and/or rotation of a person such as a viewer. Aspreviously noted, the translation determiner 874 and rotation determiner876 are adapted to determine, e.g. to measure direction and/or magnitudeof, translations and/or rotations. The sensor 888 is adapted to supplydata so as to facilitate determination of translation and/or rotation bythe translation determiner 874 and/or the rotation determiner 876.

As previously stated with regard to FIG. 6, the present embodiment isnot particularly limited with regard to how translation and/or rotationmay be determined. Likewise, the present embodiment is not particularlylimited with regard to how data for such determinations may be obtained,or what sensor(s) may be utilized for acquiring data for suchdeterminations.

In particular, although the sensor 888 is shown in FIG. 8 as being indirect communication with the processor 872, this is an example only.For at least certain embodiments, the sensor 888 may be a considerabledistance from the processor 872, and/or may not be in directcommunication with the processor 872. For example, data might begathered by a sensor 888 and conveyed to the processor through somecommunication system (e.g. wifi, data lines, etc.), or might be storedin some storage unit and subsequently read therefrom by the processor872, etc.

The apparatus 870 further includes an outputter 890 in communicationwith the processor 872, and thus notably in communication with the worldspace controller 878, sphere space controller 880, and display spacecontroller 882. The outputter 890 is adapted to output at least certainaspects of world space, sphere space, and/or display space, and/orchanges thereto. More particularly, the outputter 890 is adapted tooutput the substantially corresponding translation of said viewer withrespect to world space; to output the substantially correspondingrotation of the viewer with respect to world space; to output thesubstantially corresponding translation of the viewer with respect tosphere space; to output the substantially zero rotation of the viewerwith respect to sphere space; to output the substantially zerotranslation of the viewer with respect to display space; and to outputthe substantially zero rotation of the viewer with respect to displayspace.

The outputter 890 may, for at least certain embodiments, output theentirety of world space, sphere space, and/or display space, in additionto any changes (and/or lack of changes) thereto as described above. Thatis, the outputter may for example output an entire augmented realityenvironment and/or virtual reality environment, e.g. as a video displayto a user. However, this is an example only, and other arrangements maybe equally suitable.

The present embodiment is not particularly limited with regard to thetype of outputter 890. Typically, although not necessarily, theoutputter 890 may be a visual display. A range of devices may besuitable for use as the outputter 890, including but not limited tolight emitting diodes (LED), organic light emitting diodes (OLED),plasma screen panels (PDP), liquid crystal displays (LCD), etc.Likewise, the use of projected or transmitted displays, where the viewedsurface is essentially a passive screen for an image projected orotherwise transmitted after being generated elsewhere, may also besuitable. Other arrangements including but not limited to systems thatdisplay images directly onto a user's eyes also may be equally suitable.Either digital or analog display technologies may be suitable.Furthermore, as noted the present embodiment is not limited only to theuse of visual displays as an outputter 890.

Now with reference to FIG. 9, a schematic diagram of another embodimentof an apparatus 970 for interfacing with a system according to thepresent embodiment is shown therein. The apparatus 970 includes aprocessor 972 adapted for executing executable instructions. Theapparatus also includes a translation determiner 974, a rotationdeterminer 976, a world space controller 978, a sphere space controller980, and a display space controller 982.

As previously rioted, the present embodiment is not particularly limitedwith regard to the sensors and/or outputters. The example embodiment ofFIG. 9 shows an arrangement having two sensors 988A and 988B. Such anarrangement might be useful, for example, in generating stereoinformation using the sensors 988A and 988B (assuming the sensors 988Aand 988B are disposed in a stereo arrangement), potentially generatingdata for determining three dimensional translation and/or rotationinformation for a viewer therefrom.

Similarly, the example embodiment of FIG. 9 shows an arrangement havingtwo outputters 990A and 990B. Such an arrangement might be useful, forexample, in delivering stereo output using outputters 990A and 990B(assuming the outputters 990A and 990B are disposed in a stereoarrangement), potentially providing to the viewer and/or some othersystem or observer output representing three dimensional translationand/or rotation information.

Turning now to FIG. 10, a schematic diagram of another embodiment of anapparatus 1070 for interfacing with a system according to the presentembodiment is shown therein. The embodiment in FIG. 10 is adapted tosupport exceptions to the default behavior of world space, sphere space,and/or display space as previously described herein.

The apparatus 1070 includes a processor 1072 adapted for executingexecutable instructions. The apparatus also includes a translationdeterminer 1074, a rotation determiner 1076, a world space controller1078, a sphere space controller 1080, and a display space controller1082. The apparatus 1070 includes a sensor 1088 in communication withthe processor 1072, and an outputter 1090 in communication with theprocessor 1072.

The apparatus 1070 also includes an exception determiner 1084. Theexception determiner 1084 is adapted to determine the presence of anexception stimulus. For example, depending upon the embodiment theexception determiner might determine the presence of a hand gesture,spoken command, etc. used to invoke an exception to the default behaviorof world space, sphere space, and/or display space. Similarly to thetranslation determiner, rotation determiner, world space controller,sphere space controller, and display space controller and as previouslydescribed with respect to FIG. 8, the exception determiner 1084typically but not necessarily includes executable instructions and/ordata instantiated on the processor 1072, and is not limited thereto.

The exception determiner may be referred to more specifically, forexample with reference to a particular exception. Thus, an embodimentmight have for example a world rotation determiner, a world translationdeterminer, a world resizing determiner.

The apparatus 1070 further includes an exception controller 1086. Theexception controller 1086 is adapted to determine an exception responseas applied to world space, sphere space, display space, etc. Dependingon the particular exception(s) to be implemented in a given embodiment,the exception controller 1086 may be adapted to determine suitableupdates to one or more of world space, sphere space, and display space,e.g. a translation, rotation, resizing, etc. thereof, in response to theexception stimulus (as determined to be present by the exceptiondeterminer 1084). Similarly to the translation determiner, rotationdeterminer, world space controller, sphere space controller, and displayspace controller and as previously described with respect to FIG. 8, theexception determiner 1084 typically but not necessarily includesexecutable instructions and/or data instantiated on the processor 1072,and is not limited thereto.

For at least some embodiments, the sensor 1088 may sense data in supportof determining the presence of an exception stimulus, and communicatethat data to the exception determiner 1084. Likewise, for at least someembodiments the outputter may receive data associated with the exceptionresponse from the exception controller 1086, and generate output to aviewer utilizing that data.

Turning now to FIG. 11, the present embodiment is not particularlylimited with regard to form, and may be disposed on and/or incorporatedinto many shapes and/or other devices. Suitable configurations includebut are not limited to the example shown in FIG. 11, wherein the presentembodiment is illustrated in the form of a head-mounted displayresembling a pair of glasses.

As shown in FIG. 11, the example embodiment of the apparatus 1170therein includes a body 1192 having a form similar to a pair of glasses,and adapted to be worn in a similar fashion. A processor 1172 adaptedfor executing executable instructions is disposed on the body 1192.Although not visible as distinct entities, the processor 1172 wouldsupport thereon of a translation determiner, a rotation determiner, aworld space controller, a sphere space controller, and a display spacecontroller, e.g. in the form of executable instructions and/or datainstantiated on the processor 1172.

The apparatus 1170 also includes sensors 1188A and 1188B disposed on thebody 1192, illustrated as imagers in a stereo configuration. Theapparatus 1170 further includes outputters 1190A and 1190B disposed onthe body 1192, illustrated as visual displays also in a stereoconfiguration.

It is noted that in the configuration shown, the body 1192 is configuredand the sensors 1188A and 1188B are disposed thereon such that when thebody 1192 is worn by a viewer, the sensors 1188A and 1188B would besubstantially aligned with the lines of sight of the viewer's eyes, andcould potentially encompass fields of view at least somewhat comparableto those of the viewer's eyes, assuming sensors 1188A and 1188B withfields of view similar in extent to those of the viewer.

Similarly, in the configuration shown the body 1192 is configured andthe outputters 1190A and 1190B are disposed thereon such that when thebody 1192 is worn by a viewer, the outputters 1190A and 1190B would beproximate to and substantially in front of the viewer's eyes.

However, it is emphasized that the arrangement in FIG. 11 is an exampleonly, and that other arrangements may be equally suitable.

Referring now to FIG. 12, therein is shown a method for enabling acapability to manage interaction with a three dimensional interface inaccordance with the present embodiment.

In the example method of FIG. 12, a translation determiner isinstantiated on a processor 1252. The translation determiner includesexecutable instructions adapted for determining a translation of aviewer, e.g. within a virtual and/or augmented reality environment. Atranslation determiner according to the present embodiment has beenpreviously described herein.

The present embodiment is not particularly limited with regard to thesource of the translation determiner and/or executable instructionsthereof. Typically, though not necessarily, the translation determinermight be instantiated onto the processor 1252 from a data store such asa hard drive, solid state drive, etc., or from a communications linksuch as wifi, a wired connection, etc. However, these are examples only,and other arrangements may be equally suitable. (These comments likewiseapply to similar steps in FIGS. 12 and 13 herein, in that the presentembodiment is not particularly limited with regard to sources forinformation associated therewith.)

Continuing in FIG. 12, a rotation determiner is instantiated on theprocessor 1254. The rotation determiner includes executable instructionsadapted for determining a rotation of a viewer, e.g. within a virtualand/or augmented reality environment. A rotation determiner according tothe present embodiment has been previously described herein.

A world space controller is instantiated on the processor 1258. Theworld space controller includes executable instructions adapted fordetermining a translation of the viewer with respect to world space thatsubstantially corresponds with the translation of the viewer, and fordetermining a rotation of the viewer with respect to world space thatsubstantially corresponds with the rotation of the viewer. A world spacecontroller according to the present embodiment has been previouslydescribed herein.

A sphere space controller is instantiated on the processor 1260. Thesphere space controller includes executable instructions adapted fordetermining a translation of the viewer with respect to sphere spacethat substantially corresponds with the translation of the viewer, andfor determining a substantially zero rotation of the viewer with respectto sphere space. A sphere space controller according to the presentembodiment has been previously described herein.

A display space controller is instantiated on the processor 1262. Thedisplay space controller includes executable instructions adapted fordetermining a substantially zero translation of the viewer with respectto display space regardless of the translation of the viewer, and fordetermining a substantially zero rotation of the viewer with respect todisplay space. A display space controller according to the presentembodiment has been previously described herein.

Although FIG. 12 shows the method therein as being complete followingstep 1262, it is emphasized that the method in FIG. 12 is an exampleonly. Other steps, other functions, etc. may be incorporated into themethod, and/or other methods may be executed in combination with themethod according to the present embodiment. For example, for at leastsome embodiments other executable instructions and/or data may beinstantiated onto the processor, whether related to the method stepsdescribed herein or otherwise.

Referring now to FIG. 13, therein is shown a method for enabling acapability to manage interaction with a three dimensional interface inaccordance with the present embodiment, further enabling exceptions todefault behaviors as described elsewhere herein.

In the example method of FIG. 13, a translation determiner isinstantiated on a processor 1352. A rotation determiner also isinstantiated on the processor 1354.

Moving on in FIG. 13, an exception determiner is instantiated on theprocessor 1356. The exception determiner includes executableinstructions adapted for determining the presence of an exceptionstimulus. An exception determiner according to the present embodimenthas been previously described herein.

A world space controller is instantiated on the processor 1358. A spherespace controller also is instantiated on the processor 1360. A displayspace controller further is instantiated on the processor 1362.

Continuing in FIG. 13, an exception controller is instantiated on theprocessor 1364. The exception controller includes executableinstructions adapted for determining an exception response as applied toworld space, sphere space, display space, etc. An exception controlleraccording to the present embodiment has been previously describedherein.

Although FIG. 13 shows the method therein as being complete followingstep 1364, it is emphasized that the method in FIG. 13 is an exampleonly. Other steps, other functions, etc. may be incorporated into themethod, and/or other methods may be executed in combination with themethod according to the present embodiment. For example, for at leastsome embodiments other executable instructions and/or data may beinstantiated onto the processor, whether related to the method stepsdescribed herein or otherwise.

The present embodiment may be utilized with and/or incorporated intomany forms, including but not limited to processors, devices and systemshaving processors therein, and devices and systems controlled in wholeor in part by processors. Now with reference to FIG. 14, therein isshown an example of a use-case utilizing an embodiment of the presentembodiment. The example of FIG. 14 considers an arrangement with respectto a hardware device such as the head-mounted display illustrated inFIG. 11. As shown and described with regard to FIG. 14, such hardwaremight for example be controlled with manipulation of an interface in oneof or distributed through two or more of world space, sphere space, anddisplay space according to the present embodiment. More concretely,virtual or augmented reality icons, controls, etc. may be disposedwithin world space, sphere space, and/or display space, and manipulatedby the gestures of the person wearing the head-mounted display. Thosegestures may be detected with camera (such as shown on the head-mounteddisplay in FIG. 11), and interpreted using a processor (such as shown onthe head-mounted display in FIG. 111), typically though not necessarilywith executable instructions instantiated thereon. Commands then may beexecuted in response to the postures/gestures, at least certain suchcommands producing or altering visual output delivered to displayscreens (again such as those shown on the head-mounted display in FIG.11), e.g. changes to a virtual reality and/or augmented realityinterface, environment, etc. (including but not limited to world space,sphere space, and/or display space themselves).

It is noted that a similar but more detailed example to that in FIG. 14is presented in FIG. 15A, FIG. 15B, and FIG. 15C. Where FIG. 14 shows anoverview of a larger method that may incorporate an embodiment of thepresent embodiment, FIG. 15A through FIG. 15C illustrate morespecifically how individual steps in an example method according to thepresent embodiment (similar to that already shown and described withregard to FIG. 6) may be understood to serve within a practicalimplementation such as a head-mounted display. It is emphasized howeverthat the present embodiment is not limited only to head-mounteddisplays, nor to the specific example methods shown in FIG. 14 and/or inFIG. 15A through FIG. 15C.

In FIG. 14, a control stimulus is established 1416 for a processor. Acontrol stimulus is some form of action, manipulation, input, etc. thatmay serve to invoke some function within the processor or some systemcontrolled by or otherwise in communication with a processor. Forexample, a control stimulus might be a specific hand gesture to beperformed in free space, manipulation of a virtual icon or other entityin some specified fashion, etc. Typically, though not necessarily, acontrol stimulus may be established through instantiating executableinstructions on the processor in question, for example as part of anoperating system, an application, a gesture library, etc. These areexamples only, and other arrangements may be equally suitable.

A control response is established 1418 for a processor. A controlresponse is a processor function, operation in some system controlled orotherwise in communication with the processor, etc., to be carried outin response to a control stimulus (the associated control stimulushaving been established in step 1416). Typically though not necessarily,a control response may be established through instantiating executableinstructions on the processor in question, for example as part of anoperating system, an application, a gesture library, etc. These areexamples only, and other arrangements may be equally suitable.

Moving on in FIG. 14, an interface arrangement is established 1421 forthe processor. The interface arrangement may include, but is not limitedto, an arrangement of world space, sphere space, and display spaceaccording to the present embodiment.

In more colloquial terms with regard to steps 1416, 1418, and 1421 inFIG. 14, and particularly with regard to an example of a head-mounteddisplay worn by a viewer (though the present embodiment is not limitedonly thereto), establishing 1416 the control stimulus may be consideredas setting “what the viewer does” in terms of input, establishing 1418the control response may be considered as setting “what the system doesin response” to the viewer's input, and establishing the interfacearrangement 1421 may be considered as providing an arrangement whereinthe viewer may deliver such input, and/or experience such response.However this is an example only, and should not be understood aslimiting the present embodiment only to such arrangements.

Continuing in FIG. 14, the interface arrangement is maintained 1431.That is, in the event of some change to conditions, the interface(established in step 1421) may respond in some fashion withoutnecessarily being made irrelevant, being deactivated, etc. Typicallythough not necessarily, the interface may update in some fashion so asto retain usefulness for accepting additional control stimuli from theviewer, and/or for accommodating additional control responses resultingfrom the control stimuli. For the purposes of the example in FIG. 14, aninterface arrangement having a world space, sphere space, and displayspace may respond to translation and/or rotation as previously describedherein with regard to the world space, sphere space, and display space.As a more concrete example, when a viewer translates and/or rotates,their relationship with world space, sphere space, and/or display spacemay be updated (e.g. as described previously herein with regard to worldspace, sphere space, and display space). Note that maintaining theinterface arrangement does not imply that the interface arrangement isor should be static, only that changes are accommodated. To continue theexample above, translating might move a viewer away a control icon inworld space, but world space (and possibly sphere space and/or displayspace) will update to accommodate the translation.

Still with reference to FIG. 14, a determination is made 1494 as towhether the control stimulus is present. If the determination ispositive—if the control stimulus (e.g. gesture, etc.) is present—thenthe method proceeds to step 1496. If the determination is negative—ifthe control stimulus is not present—then the method skips step 1496.

If the determination in step 1494 is positive, the control response isexecuted 1496. That is, whatever processor function, operation, etc. asestablished in step 1418 is carried out by and/or within the processor.This may result, for example considering a head-mounted display, in achange in content as displayed to the viewer (new content added,existing content modified or removed, etc.), a change in the behavior ofthe interface thereof (e.g. changes to the parameters by which worldspace, sphere space, and/or display space operate), activation ordeactivation of some component of the head-mounted display,communication with some external system, activation of, deactivation of,and/or input to an operating system, application, etc., and so forthOther arrangements also may be equally suitable.

Although FIG. 14 shows the method therein as being complete followingstep 1594, it is emphasized that the method in FIG. 14 is an exampleonly. Other steps, other functions, etc. may be incorporated into themethod, and/or other methods may be executed in combination with themethod according to the present embodiment.

Turning now to FIG. 15A through FIG. 15C, therein another example isillustrated showing more specifically how individual steps in an examplemethod according to the present embodiment (similar to that alreadyshown and described with regard to FIG. 6) may be understood to servewithin a practical implementation such as a head-mounted display(similar to that already shown and described with regard to FIG. 11).Again, it is emphasized that this is an example only, and the presentembodiment is not limited only thereto.

In FIG. 15A, a control icon is established 1514 for a head-mounteddisplay (abbreviated “HMD” in FIG. 15A through FIG. 15C). For theexample arrangement of FIG. 15A, the control icon may be considered torepresent a virtual entity marking a position at which a viewer using ahead-mounted display may execute a control gesture as input forcontrolling the HMD, programs running thereon, systems in communicationtherewith, etc. For example, the control icon might be a visible virtualswitch, as might suggest to a viewer thereof changing the switchposition with a suitable hand motion. However this is an example only.The control icon also may be a bounding box (visible or invisible)indicating a position, may be a virtual representation of a physicalcontrol such as a keyboard or dial, or may take some other form. Otherarrangements also may be equally suitable.

A control gesture is established 1516 for the processor of thehead-mounted display. The control gesture (at least somewhat similar toa control stimulus as described with regard to step 1416 of FIG. 14) isa hand gesture to be carried out by a viewer using the head-mounteddisplay, so as to invoke some function within the processor in thehead-mounted display, or some system controlled by or otherwisecommunication therewith. To continue the example in step 1514, thecontrol gesture may be a hand motion corresponding with flipping aswitch, made proximate the control icon established in step 1514.However, other arrangements may be equally suitable.

A control instruction is established 1518 for the head-mounted displayprocessor. The control instruction is a processor instruction to beexecuted by the processor (at least somewhat similar to the controlresponse described with regard to step 1418 in FIG. 14). Again tocontinue the example for steps 1514 and 1516, the control instructionmay be to apply augmented reality information associated with thephysical environment as viewed by the wearer of the head-mounted display(for example given a head-mounted display that is optically transparentso as to facilitate such). As more concrete examples, a passing busmight be assigned a tag identifying number and/or route, a driving pathmight be marked along the roadway, a nearby restaurant might exhibit a“star” rating based on reviews or menu highlights, etc. Otherarrangements may be equally suitable.

Moving on in FIG. 15A, an interface arrangement is established 1521 (atleast somewhat similar to what is described above with regard to step1421 in FIG. 14). For purposes of the example in FIG. 15A, establishing1521 the interface arrangement may be considered to include certainsub-steps, at least somewhat similar to steps already described herein(for example with regard to FIG. 6).

Namely, a world space is established 1522. A sphere space is established1524. A display space is established 1526. A world space, sphere space,and display space according to the present embodiment and theestablishment thereof are previously described herein.

It is noted that the control icon established in step 1514 may beaffixed to, disposed within, and/or otherwise associated with any ofworld space, sphere space, and display space, and/or with some otherspace or no space (e.g. being a fully independent entity with uniquebehaviors). As such, the control icon may move (and/or depending onconditions not move) with world space, sphere space, and/or displayspace, depending on the association of the control icon.

Now with reference to FIG. 15B, the interface arrangement is maintained1531 (at least somewhat similar to what is described above with regardto step 1431 in FIG. 14). Again for purposes of the example in FIG. 15B,maintaining 1531 the interface arrangement may be considered to includecertain sub-steps, at least somewhat similar to steps already describedherein (for example with regard to FIG. 6).

Namely, a determination is made 1532 as to whether a viewer translationis present. If the determination is negative—if a viewer translation isnot found to be present—the method continues with step 1540. If thedetermination is positive—if a viewer translation is found to bepresent—the method continues with step 1534.

For purposes of the example in FIG. 15A through FIG. 15C, thedetermination 1532 of translation may be made for example throughacquiring data from one or more sensors on the head-mounted display. Forexample, changes in the field of view a camera on the head-mounteddisplay may be evaluated (e.g. using executable instructions disposed onthe processor) to determine direction and/or magnitude of translation,etc. Alternately, accelerometers or other motion sensors disposed on thehead-mounted display (not shown in the example head-mounted display ofFIG. 11) might generate information regarding direction and/or magnitudeof translation, etc. These are examples only and other arrangements maybe equally suitable. The present embodiment is not limited with regardto how a determination of translation is made.

If the determination 1532 is positive, a translation is manifested 1534with respect to world space, the translation at least substantiallycorresponding with the viewer translation. Substantially zerotranslation is manifested 1536 with respect to sphere space, andsubstantially zero translation is manifested 1538 with respect todisplay space.

Moving on in FIG. 15B, a determination is made as to whether a viewerrotation is present. If the determination is negative—if a viewerrotation is not found to be present—the method continues with step 1593.If the determination is positive—if a viewer rotation is found to bepresent—the method continues with step 1542.

For purposes of the example in FIG. 15A through FIG. 15C, thedetermination 1540 of rotation may be made for example through acquiringdata from one or more sensors on the head-mounted display. For example,changes in the field of view a camera on the head-mounted display may beevaluated (e.g. using executable instructions disposed on the processor)to determine direction and/or magnitude of translation, etc.Alternately, gyroscopes or other motion sensors disposed on thehead-mounted display (not shown in the example head-mounted display ofFIG. 11) might generate information regarding direction and/or magnitudeof rotation, etc. These are examples only and other arrangements may beequally suitable. The present embodiment is not limited with regard tohow a determination of rotation is made.

If the determination 1540 is positive, a rotation is manifested 1542with respect to world space, the rotation at least substantiallycorresponding with the viewer rotation. A rotation is also manifested1544 with respect to sphere space, the rotation at least substantiallycorresponding with the viewer rotation. Substantially zero rotation ismanifested 1546 with respect to display space.

Now with reference to FIG. 15C, a gesture image is captured 1593 with acamera disposed on the head-mounted display, the gesture image being animage that may (but also may not) include evidence of the controlgesture (established in step 1516 being executed) in association withthe control icon (established in step 1514).

A determination is made 1594 as to whether the control gesture ispresent in the gesture image. If the determination is positive—if thecontrol gesture is found to be present—then the method continues in step1596. If the determination is negative—if the control gesture is notfound to be present—then the method skips steps 1596 and 1598.

For purposes of the example in FIG. 15A through FIG. 15C, thedetermination 1594 of the presence of the control gesture may be madefor example through image evaluation the gesture image (or a series ofsuch images over time, etc.). For example, the image(s) may be searchedfor a hand, that hand segmented from the background of the image, theconfiguration and/or changes in configuration over time for that handcompared to a standard for the control gesture (such standard forexample possibly having been provided as part of establishing thecontrol gesture 1516), etc. However, this is an example only, and otherarrangements may be equally suitable. The present embodiment is notlimited with regard to how a determination of the presence of thecontrol gesture is made.

Moving on in FIG. 15C, the control instruction is executed 1596A in thehead-mounted display processor (that control instruction having beenestablished in step 1518). To continue the particular example previouslypresented with respect to steps 1514, 1516, 1518, etc., the processormay read, calculate, or otherwise make available augmented realityinformation associated with the physical environment surrounding thehead-mounted display (and thus typically also surrounding the personwearing the head-mounted display).

In the embodiment shown in FIG. 15C, the execution of the controlinstruction is shown as two distinct sub-steps, 1596A and 1596B. This isan example only, to illustrate that steps may be split; likewise stepsmay be combined. For the particular example of FIG. 15C, in step 1596A acontrol instruction is executed within a processor, and (as describedimmediately hereafter) in step 1596B a visible change is outputted to aviewer as part of that execution. However, such an arrangement is anexample only, and other arrangements may be equally suitable.

Moving on in FIG. 15C, as noted execution of the control instruction maybe carried out by the processor, but may not necessarily be limited onlyto processor actions. In the example of FIG. 15C, the effects of thecontrol instruction are manifested 1596B by the screen(s) of thehead-mounted display. To continue the particular example above, theaugmented reality information may be outputted in visible form so as tobe overlaid on or otherwise associated with the physical environmentsurrounding the head-mounted display. Thus, following the examplepresented with respect to step 1518 the tags for the bus might bevisibly displayed hovering over the bus, the driving path might bevisibly displayed overlaid on the roadway, the star ratings or menuhighlights might be displayed in free space near the door to therestaurant, etc.

However, as noted previously with regard to outputting and appearance ofworld space, sphere space, and display space with regard to FIG. 6, thepresent embodiment does not require that all embodiments, or anyparticular control instruction in a given embodiment, necessarilyproduce visible changes. For at least certain embodiments non-visiblechanges may be suitable, such as changes to permissions, security,communication protocols, etc.

Although FIG. 15C shows the method therein as being complete followingstep 1594, it is emphasized that the method in FIG. 15A through FIG. 15Cis an example only. Other steps, other functions, etc. may beincorporated into the method, and/or other methods may be executed incombination with the method according to the present embodiment.

The above specification, examples, and data provide a completedescription of the manufacture and use of the composition of theembodiment. Since many embodiments of the embodiment can be made withoutdeparting from the spirit and scope of the embodiment, the embodimentresides in the claims hereinafter appended.

The invention claimed is:
 1. A method, comprising: receiving, from aninput device, a first constructive movement input representative of anon-translational movement of a body of a user, wherein: the body doesnot move from a first point in a physical world environment to a secondpoint in the physical world environment; and the non-translationalmovement mimics a movement of the body translationally moving from thefirst point to the second point; executing, by a processing device, atranslational instruction associated with the first constructivemovement input, wherein: the translational instruction comprises movingthe body in a world space of an augmented reality environment from thefirst point to the second point; and the world space is a portion of thephysical world environment being substantially bound by a portion of aphysical world environment relative to a head-mounted display;receiving, from the input device, a first rotation stimulus; in responseto receiving the first rotation stimulus, executing, by the processingdevice, a first rotation instruction to rotate: a portion of the worldspace as displayed by a head-mounted display by a first amount indicatedby the first rotation stimulus; a portion of a sphere space as displayedby the head-mounted display by the first amount; or a portion of adisplay space as displayed by the head-mounted display by the firstamount, wherein: as the world space rotates, the sphere space or thedisplay space is fixed; as the sphere space rotates, the world space orthe display space is fixed; or as the display space rotates, the worldspace or the sphere space is fixed; receiving, from the input device, asecond constructive movement input; and executing, by the processingdevice, a second translational instruction associated with the secondconstructive movement input, wherein the second translationalinstruction comprises moving the body a second distance in the spacethat corresponds with a first actual movement of the body in thephysical world environment.
 2. The method of claim 1, wherein: theaugmented reality environment comprises one or more objects overlaidonto the physical world environment; or the processing device is adaptedto display the physical world environment as a virtual realityenvironment, wherein the portion of the world space that is rotated is aportion of the physical world environment displayed as the virtualreality environment.
 3. The method of claim 1, wherein: the firstrotation stimulus is a user input; the user input comprises at least oneof a voice command, a hand posture, a hand gesture, a stylus posture, astylus gesture, an eye gesture, or a brainwave modulation.
 4. The methodof claim 1, wherein the second constructive movement input comprisesconstructive rotational movement that corresponds to rotational movementby the head-mounted display where the head-mounted display remains atthe first point and rotates about an axis.
 5. The method of claim 1,wherein the first rotation stimulus is indicative of the bodyinteracting with an augmented reality object displayed in the physicalworld environment.
 6. The method of claim 1, further comprising:receiving, from the input device, a resizing stimulus; executing, by theprocessing device, a resizing instruction to change a size of theportion of the world space, the sphere space, or the display space asdisplayed by the head-mounted display by an amount indicated by theresizing stimulus; receiving, from the input device, a thirdconstructive movement input; and executing, by the processing device, athird translational instruction associated with the third constructivemovement input, wherein the third translational instruction comprisesmoving the body a third distance in the world space, the sphere space,or the display space that corresponds with a second actual movement ofthe body in the physical world environment.
 7. A method, comprising:receiving a first constructive movement input representative of a firstgesture of a body of a user, wherein: the body of the user remains in afixed position between a first point in the physical world environmentand a second position in a physical world environment; and the firstgesture mimics a movement of the body translationally moving from thefirst point to the second point; executing a translational instructionassociated with the first constructive movement input, wherein: thetranslational instruction comprises moving the body in a world space ofan augmented reality environment from the first point to the secondpoint; and the world space is a portion of the physical worldenvironment being substantially bound by a portion of a physical worldenvironment relative to a head-mounted display; in response to receivinga first resizing stimulus, executing a first resizing instruction tochange: a size of a portion of the world space; a size of a portion of asphere space; or a size of a portion of a display space, wherein: theworld space, the sphere space, or the display space is displayed by ahead-mounted display; an amount of the change is indicated by the firstresizing stimulus; as the size of the portion of the world spacechanges, the size of the portion of the sphere space is constant or thesize of the portion of the display space is constant; as the size of theportion of the sphere space changes, the size of the portion of theworld space is constant or the size of the portion of the display spaceis constant; and as the size of the portion of the display spacechanges, the size of the portion of the world space is constant or thesize of the portion of the sphere space is constant; receiving, from theinput device, a second constructive movement input; and executing asecond translational instruction associated with the second constructivemovement input, wherein the second translational instruction comprisesmoving the body a second distance in the world space that correspondswith a first actual movement of the body in the physical worldenvironment.
 8. The method of claim 7, further comprising: receiving,from the input device, a rotation stimulus; executing a rotationinstruction to rotate the world space, the sphere space, or the displayspace as displayed by the head-mounted display by an amount indicated bythe rotation stimulus; receiving, from the input device, a thirdconstructive movement input; and executing a third translationalinstruction associated with the third constructive movement input,wherein the third translational instruction comprises moving the body athird distance in the world space that corresponds with a second actualmovement of the body in the physical world environment.
 9. The method ofclaim 8, wherein: as the world space rotates, the sphere space remainsfixed relative to the user or the display space remains fixed relativeto the user; as the sphere space rotates, the world space remains fixedrelative to the user or the display space remains fixed relative to theuser; and as the display space rotates, the world space remains fixedrelative to the user or the sphere space remains fixed relative to theuser.
 10. The method of claim 7, further comprising: receiving, from theinput device, a space translation stimulus; executing a spacetranslation instruction to move the world space, the sphere space, orthe display space as displayed by the head-mounted display from a thirdpoint relative to the physical world environment to a fourth pointrelative to the physical world environment, as indicated by the spacetranslation stimulus; receiving, from the input device, a thirdconstructive movement input; and executing a third translationalinstruction associated with the third constructive movement input,wherein the third translational instruction comprises moving the body athird distance in the world space that corresponds with a second actualmovement of the body in the physical world environment.
 11. The methodof claim 10, wherein the space translation stimulus is at least one of asecond gesture, a verbal command, or a signal or data from anotherdevice or input device.
 12. The method of claim 10, wherein: as theworld space translates, the sphere space remains fixed relative to theuser or the display space remains fixed relative to the user; as thesphere space translates, the world space remains fixed relative to theuser or the display space remains fixed relative to the user; and as thedisplay space translates, the world space remains fixed relative to theuser or the sphere space remains fixed relative to the user.
 13. Themethod of claim 7, wherein: executing the first resizing instructioncomprises changing a size of a portion of a virtual object; the virtualobject is displayed on the head-mounted display in the physical worldenvironment; the virtual object is disposed in: the world space suchthat the virtual object moves with the world space relative to the bodyof the user; the sphere space such that the virtual object moves withthe sphere space relative to the body of the user; or the display spacesuch that the virtual object moves with the display space relative tothe body of the user; and the size of the portion of the world space,the size of the portion of the sphere space, and the size of the portionof the display space remain constant as the size of the portion of thevirtual object is changed.
 14. A method, comprising: receiving a firstconstructive movement input representative of a first gesture of a bodyof a user, wherein: the body of the user remains in a fixed positionbetween a first point and a second position in a physical worldenvironment; and the first gesture mimics a movement of the bodytranslationally moving from the first point to the second point;executing a translational instruction associated with the firstconstructive movement input, wherein: the translational instructioncomprises moving the body in an augmented reality environment from thefirst point to the second point; the augmented reality environmentcomprises a world space, a sphere space, and a display space in thephysical world environment; the augmented reality environment issubstantially bound by a portion of a physical world environmentrelative to a head-mounted display; a set of default behaviors of theworld space, the sphere space, or the display space governs movement ofthe world space, the sphere space, or the display space in the augmentedreality environment; in response to receiving a space exceptionstimulus, execute a first movement instruction to move the world space,the sphere space, or the display space relative to the physical worldenvironment, wherein the movement of the world space, the sphere space,or the display space comprises an exception to the set of defaultbehaviors; receiving a second constructive movement input; and executinga second translational instruction associated with the secondconstructive movement input, wherein the second translationalinstruction comprises moving the body a first distance in the augmentedreality environment that corresponds with a first actual movement of thebody in the physical world environment.
 15. The method of claim 14,further comprising adapting the physical world environment to bedisplayed as a virtual reality environment, wherein the world space, thesphere space, or the display space is a portion of the physical worldenvironment displayed as the virtual reality environment.
 16. The methodof claim 14, further comprising: receiving, from the input device, aresizing stimulus; executing a resizing instruction to change a size ofa portion of the world space, the sphere space, or the display space asdisplayed by the head-mounted display by an amount indicated by theresizing stimulus; receiving, from the input device, a thirdconstructive movement input; and execute a third translationalinstruction associated with the third constructive movement input,wherein the third translational instruction comprises moving the body asecond distance that corresponds with a second actual movement of thebody in the physical world environment.
 17. The method of claim 14,wherein the first movement instruction comprises: a translation of theworld space, the sphere space, or the display space relative to thephysical world environment; or rotation of the world space, the spherespace, or the display space relative to the physical world environment.18. The method of claim 14, wherein the exception is a positiveexception that induces movement of the world space, the sphere space, ordisplay space relative to the physical world environment.
 19. The methodof claim 14, wherein the exception is a negative exception that removesmovement of the world space, the sphere space, or the display spacerelative to the physical world environment as the body actuallytranslates in the physical world environment.